2023-02-18 03:00:47,684 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-18 03:00:47,731 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=111, ProcessCount=163, AvailableMemoryMB=5449 2023-02-18 03:00:47,958 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d 2023-02-18 03:00:47,964 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:00:47,965 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900, deleteOnExit=true 2023-02-18 03:00:47,965 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:00:47,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/test.cache.data in system properties and HBase conf 2023-02-18 03:00:47,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:00:47,966 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:00:47,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:00:47,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:00:47,967 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:00:48,046 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-18 03:00:48,364 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:00:48,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:00:48,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:00:48,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:00:48,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:00:48,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:00:48,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:00:48,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:00:48,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:00:48,372 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:00:48,372 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:00:48,372 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:00:48,373 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:00:48,373 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:00:48,373 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:00:48,814 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:00:48,817 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:00:49,052 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-18 03:00:49,202 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-18 03:00:49,227 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:00:49,259 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:00:49,298 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/java.io.tmpdir/Jetty_localhost_localdomain_39257_hdfs____.1m6ghk/webapp 2023-02-18 03:00:49,449 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:39257 2023-02-18 03:00:49,459 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:00:49,459 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:00:49,930 WARN [Listener at localhost.localdomain/44311] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:00:50,005 WARN [Listener at localhost.localdomain/44311] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:00:50,024 WARN [Listener at localhost.localdomain/44311] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:00:50,031 INFO [Listener at localhost.localdomain/44311] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:00:50,035 INFO [Listener at localhost.localdomain/44311] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/java.io.tmpdir/Jetty_localhost_46429_datanode____1tcjz4/webapp 2023-02-18 03:00:50,129 INFO [Listener at localhost.localdomain/44311] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46429 2023-02-18 03:00:50,503 WARN [Listener at localhost.localdomain/40583] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:00:50,525 WARN [Listener at localhost.localdomain/40583] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:00:50,531 WARN [Listener at localhost.localdomain/40583] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:00:50,533 INFO [Listener at localhost.localdomain/40583] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:00:50,539 INFO [Listener at localhost.localdomain/40583] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/java.io.tmpdir/Jetty_localhost_36881_datanode____.37rga3/webapp 2023-02-18 03:00:50,635 INFO [Listener at localhost.localdomain/40583] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36881 2023-02-18 03:00:50,655 WARN [Listener at localhost.localdomain/40571] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:00:50,909 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfff409bf87861c20: Processing first storage report for DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228 from datanode 5bbff44f-8a58-40ec-af75-c576d346efca 2023-02-18 03:00:50,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfff409bf87861c20: from storage DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228 node DatanodeRegistration(127.0.0.1:34621, datanodeUuid=5bbff44f-8a58-40ec-af75-c576d346efca, infoPort=38905, infoSecurePort=0, ipcPort=40571, storageInfo=lv=-57;cid=testClusterID;nsid=1404518673;c=1676689248871), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 03:00:50,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x39c922c34e6f3499: Processing first storage report for DS-4c429aba-39d6-4809-b26f-50290b1f9f2a from datanode 6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc 2023-02-18 03:00:50,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x39c922c34e6f3499: from storage DS-4c429aba-39d6-4809-b26f-50290b1f9f2a node DatanodeRegistration(127.0.0.1:37401, datanodeUuid=6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc, infoPort=35087, infoSecurePort=0, ipcPort=40583, storageInfo=lv=-57;cid=testClusterID;nsid=1404518673;c=1676689248871), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:00:50,910 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfff409bf87861c20: Processing first storage report for DS-f55c66e4-7b6c-4a9d-97a5-646243e5df03 from datanode 5bbff44f-8a58-40ec-af75-c576d346efca 2023-02-18 03:00:50,910 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfff409bf87861c20: from storage DS-f55c66e4-7b6c-4a9d-97a5-646243e5df03 node DatanodeRegistration(127.0.0.1:34621, datanodeUuid=5bbff44f-8a58-40ec-af75-c576d346efca, infoPort=38905, infoSecurePort=0, ipcPort=40571, storageInfo=lv=-57;cid=testClusterID;nsid=1404518673;c=1676689248871), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:00:50,911 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x39c922c34e6f3499: Processing first storage report for DS-b2c6a6a8-2965-4b03-bd25-6b8247270c63 from datanode 6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc 2023-02-18 03:00:50,911 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x39c922c34e6f3499: from storage DS-b2c6a6a8-2965-4b03-bd25-6b8247270c63 node DatanodeRegistration(127.0.0.1:37401, datanodeUuid=6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc, infoPort=35087, infoSecurePort=0, ipcPort=40583, storageInfo=lv=-57;cid=testClusterID;nsid=1404518673;c=1676689248871), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:00:51,186 DEBUG [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d 2023-02-18 03:00:51,273 INFO [Listener at localhost.localdomain/40571] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/zookeeper_0, clientPort=56438, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:00:51,290 INFO [Listener at localhost.localdomain/40571] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56438 2023-02-18 03:00:51,298 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:51,300 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:51,928 INFO [Listener at localhost.localdomain/40571] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a with version=8 2023-02-18 03:00:51,929 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:51,930 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:51,933 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/hbase-staging 2023-02-18 03:00:52,204 INFO [Listener at localhost.localdomain/40571] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-18 03:00:52,586 INFO [Listener at localhost.localdomain/40571] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:00:52,615 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:52,616 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:52,616 INFO [Listener at localhost.localdomain/40571] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:00:52,616 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:52,616 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:00:52,741 INFO [Listener at localhost.localdomain/40571] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:00:52,801 DEBUG [Listener at localhost.localdomain/40571] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-18 03:00:52,884 INFO [Listener at localhost.localdomain/40571] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39021 2023-02-18 03:00:52,893 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:52,895 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:52,914 INFO [Listener at localhost.localdomain/40571] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39021 connecting to ZooKeeper ensemble=127.0.0.1:56438 2023-02-18 03:00:52,951 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:390210x0, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:00:52,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39021-0x10173875d660000 connected 2023-02-18 03:00:52,978 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:00:52,979 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:00:52,982 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:00:52,989 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39021 2023-02-18 03:00:52,989 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39021 2023-02-18 03:00:52,991 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39021 2023-02-18 03:00:52,991 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39021 2023-02-18 03:00:52,991 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39021 2023-02-18 03:00:52,997 INFO [Listener at localhost.localdomain/40571] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a, hbase.cluster.distributed=false 2023-02-18 03:00:53,060 INFO [Listener at localhost.localdomain/40571] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:00:53,061 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:53,061 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:53,061 INFO [Listener at localhost.localdomain/40571] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:00:53,061 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:53,062 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:00:53,066 INFO [Listener at localhost.localdomain/40571] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:00:53,069 INFO [Listener at localhost.localdomain/40571] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46341 2023-02-18 03:00:53,071 INFO [Listener at localhost.localdomain/40571] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:00:53,078 DEBUG [Listener at localhost.localdomain/40571] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:00:53,079 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:53,081 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:53,084 INFO [Listener at localhost.localdomain/40571] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46341 connecting to ZooKeeper ensemble=127.0.0.1:56438 2023-02-18 03:00:53,087 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:463410x0, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:00:53,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46341-0x10173875d660001 connected 2023-02-18 03:00:53,089 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:00:53,090 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:00:53,091 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:00:53,091 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46341 2023-02-18 03:00:53,092 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46341 2023-02-18 03:00:53,095 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46341 2023-02-18 03:00:53,095 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46341 2023-02-18 03:00:53,095 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46341 2023-02-18 03:00:53,108 INFO [Listener at localhost.localdomain/40571] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:00:53,108 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:53,108 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:53,109 INFO [Listener at localhost.localdomain/40571] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:00:53,109 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:00:53,109 INFO [Listener at localhost.localdomain/40571] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:00:53,109 INFO [Listener at localhost.localdomain/40571] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:00:53,111 INFO [Listener at localhost.localdomain/40571] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41935 2023-02-18 03:00:53,111 INFO [Listener at localhost.localdomain/40571] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:00:53,115 DEBUG [Listener at localhost.localdomain/40571] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:00:53,115 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:53,118 INFO [Listener at localhost.localdomain/40571] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:53,121 INFO [Listener at localhost.localdomain/40571] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41935 connecting to ZooKeeper ensemble=127.0.0.1:56438 2023-02-18 03:00:53,125 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:419350x0, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:00:53,126 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): regionserver:419350x0, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:00:53,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41935-0x10173875d660002 connected 2023-02-18 03:00:53,127 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:00:53,128 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:00:53,131 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41935 2023-02-18 03:00:53,131 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41935 2023-02-18 03:00:53,132 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41935 2023-02-18 03:00:53,132 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41935 2023-02-18 03:00:53,132 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41935 2023-02-18 03:00:53,134 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:53,142 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:00:53,143 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:53,162 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:00:53,162 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:00:53,162 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:00:53,162 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:53,164 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:00:53,165 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,39021,1676689252067 from backup master directory 2023-02-18 03:00:53,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:00:53,168 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:53,168 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:00:53,169 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:00:53,169 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:53,173 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-18 03:00:53,174 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-18 03:00:53,276 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/hbase.id with ID: 97f01582-692a-4f56-a439-69185f969fff 2023-02-18 03:00:53,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:00:53,348 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:53,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x37597f1e to 127.0.0.1:56438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:00:53,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dadb0b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:00:53,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:00:53,464 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:00:53,480 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-18 03:00:53,480 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-18 03:00:53,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-18 03:00:53,486 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-02-18 03:00:53,487 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:00:53,521 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store-tmp 2023-02-18 03:00:53,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:53,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:00:53,554 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:00:53,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:00:53,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:00:53,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:00:53,554 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:00:53,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:00:53,557 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/WALs/jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:53,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39021%2C1676689252067, suffix=, logDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/WALs/jenkins-hbase20.apache.org,39021,1676689252067, archiveDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/oldWALs, maxLogs=10 2023-02-18 03:00:53,632 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK] 2023-02-18 03:00:53,632 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK] 2023-02-18 03:00:53,640 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-18 03:00:53,705 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/WALs/jenkins-hbase20.apache.org,39021,1676689252067/jenkins-hbase20.apache.org%2C39021%2C1676689252067.1676689253589 2023-02-18 03:00:53,705 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK], DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK]] 2023-02-18 03:00:53,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:00:53,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:53,710 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:00:53,711 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:00:53,771 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:00:53,780 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:00:53,807 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:00:53,820 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:53,827 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:00:53,829 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:00:53,845 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:00:53,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:53,851 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61942336, jitterRate=-0.07698726654052734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:00:53,851 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:00:53,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:00:53,873 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:00:53,873 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:00:53,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x39c922c34e6f349a: from storage DS-4c429aba-39d6-4809-b26f-50290b1f9f2a node DatanodeRegistration(127.0.0.1:37401, datanodeUuid=6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc, infoPort=35087, infoSecurePort=0, ipcPort=40583, storageInfo=lv=-57;cid=testClusterID;nsid=1404518673;c=1676689248871), blocks: 3, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-18 03:00:53,873 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x39c922c34e6f349a: from storage DS-b2c6a6a8-2965-4b03-bd25-6b8247270c63 node DatanodeRegistration(127.0.0.1:37401, datanodeUuid=6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc, infoPort=35087, infoSecurePort=0, ipcPort=40583, storageInfo=lv=-57;cid=testClusterID;nsid=1404518673;c=1676689248871), blocks: 2, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:00:53,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:00:53,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-18 03:00:53,906 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 28 msec 2023-02-18 03:00:53,906 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:00:53,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:00:53,936 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:00:53,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:00:53,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:00:53,970 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:00:53,977 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:00:53,982 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:00:53,984 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:53,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:00:53,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:00:54,000 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:00:54,004 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:00:54,004 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:00:54,004 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:00:54,005 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:54,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,39021,1676689252067, sessionid=0x10173875d660000, setting cluster-up flag (Was=false) 2023-02-18 03:00:54,019 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:54,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:00:54,024 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:54,029 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:54,032 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:00:54,033 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:54,037 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.hbase-snapshot/.tmp 2023-02-18 03:00:54,149 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(952): ClusterId : 97f01582-692a-4f56-a439-69185f969fff 2023-02-18 03:00:54,149 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(952): ClusterId : 97f01582-692a-4f56-a439-69185f969fff 2023-02-18 03:00:54,155 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:00:54,155 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:00:54,163 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:00:54,163 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:00:54,163 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:00:54,163 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:00:54,166 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:00:54,166 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:00:54,167 DEBUG [RS:1;jenkins-hbase20:41935] zookeeper.ReadOnlyZKClient(139): Connect 0x29f60d6b to 127.0.0.1:56438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:00:54,167 DEBUG [RS:0;jenkins-hbase20:46341] zookeeper.ReadOnlyZKClient(139): Connect 0x73fab016 to 127.0.0.1:56438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:00:54,181 DEBUG [RS:1;jenkins-hbase20:41935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66e6dd88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:00:54,182 DEBUG [RS:0;jenkins-hbase20:46341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4279a721, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:00:54,182 DEBUG [RS:1;jenkins-hbase20:41935] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@347d33c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:00:54,182 DEBUG [RS:0;jenkins-hbase20:46341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39079505, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:00:54,203 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:46341 2023-02-18 03:00:54,204 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:00:54,206 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:41935 2023-02-18 03:00:54,208 INFO [RS:0;jenkins-hbase20:46341] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:00:54,208 INFO [RS:0;jenkins-hbase20:46341] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:00:54,208 INFO [RS:1;jenkins-hbase20:41935] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:00:54,209 INFO [RS:1;jenkins-hbase20:41935] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:00:54,208 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:00:54,209 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:00:54,211 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39021,1676689252067 with isa=jenkins-hbase20.apache.org/148.251.75.209:46341, startcode=1676689253059 2023-02-18 03:00:54,211 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,39021,1676689252067 with isa=jenkins-hbase20.apache.org/148.251.75.209:41935, startcode=1676689253107 2023-02-18 03:00:54,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:00:54,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:00:54,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:00:54,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:00:54,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:00:54,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:00:54,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,217 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689284217 2023-02-18 03:00:54,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:00:54,224 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:00:54,225 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:00:54,231 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:00:54,231 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:00:54,232 DEBUG [RS:1;jenkins-hbase20:41935] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:00:54,232 DEBUG [RS:0;jenkins-hbase20:46341] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:00:54,240 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:00:54,240 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:00:54,241 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:00:54,241 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:00:54,243 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,244 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:00:54,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:00:54,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:00:54,249 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:00:54,249 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:00:54,251 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689254251,5,FailOnTimeoutGroup] 2023-02-18 03:00:54,251 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689254251,5,FailOnTimeoutGroup] 2023-02-18 03:00:54,251 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,252 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:00:54,254 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,254 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,288 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:00:54,289 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:00:54,290 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a 2023-02-18 03:00:54,301 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59539, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:00:54,301 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47401, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:00:54,316 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:54,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:00:54,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39021] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,325 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/info 2023-02-18 03:00:54,326 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:00:54,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:54,329 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:00:54,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:00:54,332 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:00:54,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:54,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:00:54,337 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/table 2023-02-18 03:00:54,337 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:00:54,339 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:54,341 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740 2023-02-18 03:00:54,342 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a 2023-02-18 03:00:54,342 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a 2023-02-18 03:00:54,342 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44311 2023-02-18 03:00:54,342 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44311 2023-02-18 03:00:54,342 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:00:54,342 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740 2023-02-18 03:00:54,342 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:00:54,347 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:00:54,349 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:00:54,350 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:00:54,351 DEBUG [RS:0;jenkins-hbase20:46341] zookeeper.ZKUtil(162): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,351 DEBUG [RS:1;jenkins-hbase20:41935] zookeeper.ZKUtil(162): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,351 WARN [RS:0;jenkins-hbase20:46341] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:00:54,352 WARN [RS:1;jenkins-hbase20:41935] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:00:54,353 INFO [RS:0;jenkins-hbase20:46341] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:00:54,353 INFO [RS:1;jenkins-hbase20:41935] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:00:54,353 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,353 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,354 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41935,1676689253107] 2023-02-18 03:00:54,354 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46341,1676689253059] 2023-02-18 03:00:54,357 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:54,359 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61486165, jitterRate=-0.08378474414348602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:00:54,359 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:00:54,359 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:00:54,359 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:00:54,359 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:00:54,360 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:00:54,360 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:00:54,361 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:00:54,361 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:00:54,365 DEBUG [RS:1;jenkins-hbase20:41935] zookeeper.ZKUtil(162): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,365 DEBUG [RS:0;jenkins-hbase20:46341] zookeeper.ZKUtil(162): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,365 DEBUG [RS:1;jenkins-hbase20:41935] zookeeper.ZKUtil(162): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,365 DEBUG [RS:0;jenkins-hbase20:46341] zookeeper.ZKUtil(162): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,367 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:00:54,367 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:00:54,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:00:54,383 DEBUG [RS:1;jenkins-hbase20:41935] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:00:54,383 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:00:54,390 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:00:54,393 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:00:54,394 INFO [RS:1;jenkins-hbase20:41935] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:00:54,394 INFO [RS:0;jenkins-hbase20:46341] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:00:54,417 INFO [RS:1;jenkins-hbase20:41935] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:00:54,418 INFO [RS:0;jenkins-hbase20:46341] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:00:54,421 INFO [RS:1;jenkins-hbase20:41935] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:00:54,421 INFO [RS:0;jenkins-hbase20:46341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:00:54,422 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,422 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,423 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:00:54,423 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:00:54,431 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,431 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,431 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,432 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,432 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,432 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,432 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,432 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,432 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:00:54,433 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:00:54,433 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:1;jenkins-hbase20:41935] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,433 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,434 DEBUG [RS:0;jenkins-hbase20:46341] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:00:54,439 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,439 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,439 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,439 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,439 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,439 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,459 INFO [RS:1;jenkins-hbase20:41935] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:00:54,460 INFO [RS:0;jenkins-hbase20:46341] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:00:54,463 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46341,1676689253059-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,463 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41935,1676689253107-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:54,481 INFO [RS:1;jenkins-hbase20:41935] regionserver.Replication(203): jenkins-hbase20.apache.org,41935,1676689253107 started 2023-02-18 03:00:54,481 INFO [RS:0;jenkins-hbase20:46341] regionserver.Replication(203): jenkins-hbase20.apache.org,46341,1676689253059 started 2023-02-18 03:00:54,481 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41935,1676689253107, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41935, sessionid=0x10173875d660002 2023-02-18 03:00:54,481 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,46341,1676689253059, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46341, sessionid=0x10173875d660001 2023-02-18 03:00:54,481 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:00:54,481 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:00:54,482 DEBUG [RS:0;jenkins-hbase20:46341] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,482 DEBUG [RS:1;jenkins-hbase20:41935] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,482 DEBUG [RS:0;jenkins-hbase20:46341] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46341,1676689253059' 2023-02-18 03:00:54,482 DEBUG [RS:1;jenkins-hbase20:41935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41935,1676689253107' 2023-02-18 03:00:54,482 DEBUG [RS:1;jenkins-hbase20:41935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:00:54,482 DEBUG [RS:0;jenkins-hbase20:46341] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:00:54,483 DEBUG [RS:1;jenkins-hbase20:41935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:00:54,483 DEBUG [RS:0;jenkins-hbase20:46341] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:00:54,484 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:00:54,484 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:00:54,484 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:00:54,484 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:00:54,484 DEBUG [RS:1;jenkins-hbase20:41935] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:54,484 DEBUG [RS:0;jenkins-hbase20:46341] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,484 DEBUG [RS:1;jenkins-hbase20:41935] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41935,1676689253107' 2023-02-18 03:00:54,484 DEBUG [RS:0;jenkins-hbase20:46341] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46341,1676689253059' 2023-02-18 03:00:54,485 DEBUG [RS:0;jenkins-hbase20:46341] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:00:54,485 DEBUG [RS:1;jenkins-hbase20:41935] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:00:54,485 DEBUG [RS:1;jenkins-hbase20:41935] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:00:54,485 DEBUG [RS:0;jenkins-hbase20:46341] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:00:54,486 DEBUG [RS:1;jenkins-hbase20:41935] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:00:54,486 DEBUG [RS:0;jenkins-hbase20:46341] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:00:54,486 INFO [RS:1;jenkins-hbase20:41935] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:00:54,486 INFO [RS:0;jenkins-hbase20:46341] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:00:54,486 INFO [RS:1;jenkins-hbase20:41935] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:00:54,486 INFO [RS:0;jenkins-hbase20:46341] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:00:54,545 DEBUG [jenkins-hbase20:39021] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:00:54,549 DEBUG [jenkins-hbase20:39021] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:00:54,554 DEBUG [jenkins-hbase20:39021] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:00:54,554 DEBUG [jenkins-hbase20:39021] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:00:54,554 DEBUG [jenkins-hbase20:39021] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:00:54,557 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46341,1676689253059, state=OPENING 2023-02-18 03:00:54,563 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:00:54,564 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:54,565 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:00:54,568 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:54,748 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:54,750 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:00:54,753 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36782, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:00:54,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:00:54,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:00:54,769 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46341%2C1676689253059.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,46341,1676689253059, archiveDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/oldWALs, maxLogs=32 2023-02-18 03:00:54,789 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK] 2023-02-18 03:00:54,789 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK] 2023-02-18 03:00:54,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,46341,1676689253059/jenkins-hbase20.apache.org%2C46341%2C1676689253059.meta.1676689254773.meta 2023-02-18 03:00:54,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK], DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK]] 2023-02-18 03:00:54,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:00:54,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:00:54,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:00:54,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:00:54,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:00:54,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:54,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:00:54,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:00:54,826 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:00:54,828 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/info 2023-02-18 03:00:54,828 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/info 2023-02-18 03:00:54,829 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:00:54,830 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:54,830 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:00:54,832 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:00:54,832 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:00:54,833 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:00:54,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:54,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:00:54,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/table 2023-02-18 03:00:54,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/table 2023-02-18 03:00:54,837 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:00:54,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:54,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740 2023-02-18 03:00:54,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740 2023-02-18 03:00:54,847 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:00:54,850 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:00:54,852 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75496105, jitterRate=0.12497963011264801}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:00:54,852 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:00:54,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689254742 2023-02-18 03:00:54,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:00:54,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:00:54,881 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,46341,1676689253059, state=OPEN 2023-02-18 03:00:54,884 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:00:54,884 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:00:54,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:00:54,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,46341,1676689253059 in 316 msec 2023-02-18 03:00:54,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:00:54,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 514 msec 2023-02-18 03:00:54,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 798 msec 2023-02-18 03:00:54,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689254900, completionTime=-1 2023-02-18 03:00:54,901 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:00:54,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:00:54,958 DEBUG [hconnection-0x22237816-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:00:54,961 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36798, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:00:54,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:00:54,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689314976 2023-02-18 03:00:54,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689374976 2023-02-18 03:00:54,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 75 msec 2023-02-18 03:00:55,002 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39021,1676689252067-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:55,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39021,1676689252067-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:55,003 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39021,1676689252067-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:55,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:39021, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:55,005 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:00:55,012 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:00:55,020 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:00:55,022 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:00:55,031 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:00:55,034 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:00:55,037 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:00:55,055 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,058 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120 empty. 2023-02-18 03:00:55,058 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,058 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:00:55,484 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:00:55,487 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4a54f3fbdf4e594b394fc115482fc120, NAME => 'hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:55,514 INFO [RS:1;jenkins-hbase20:41935] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41935%2C1676689253107, suffix=, logDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,41935,1676689253107, archiveDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/oldWALs, maxLogs=32 2023-02-18 03:00:55,514 INFO [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46341%2C1676689253059, suffix=, logDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,46341,1676689253059, archiveDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/oldWALs, maxLogs=32 2023-02-18 03:00:55,516 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:55,516 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4a54f3fbdf4e594b394fc115482fc120, disabling compactions & flushes 2023-02-18 03:00:55,516 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,516 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,516 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. after waiting 0 ms 2023-02-18 03:00:55,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,517 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,517 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4a54f3fbdf4e594b394fc115482fc120: 2023-02-18 03:00:55,521 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:00:55,534 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK] 2023-02-18 03:00:55,535 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK] 2023-02-18 03:00:55,540 INFO [RS:1;jenkins-hbase20:41935] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,41935,1676689253107/jenkins-hbase20.apache.org%2C41935%2C1676689253107.1676689255517 2023-02-18 03:00:55,542 DEBUG [RS:1;jenkins-hbase20:41935] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK], DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK]] 2023-02-18 03:00:55,543 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK] 2023-02-18 03:00:55,543 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK] 2023-02-18 03:00:55,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689255524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689255524"}]},"ts":"1676689255524"} 2023-02-18 03:00:55,548 INFO [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,46341,1676689253059/jenkins-hbase20.apache.org%2C46341%2C1676689253059.1676689255518 2023-02-18 03:00:55,549 DEBUG [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34621,DS-8b4b0f13-ca60-4c0d-bab9-240d37adf228,DISK], DatanodeInfoWithStorage[127.0.0.1:37401,DS-4c429aba-39d6-4809-b26f-50290b1f9f2a,DISK]] 2023-02-18 03:00:55,578 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:00:55,580 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:00:55,584 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689255580"}]},"ts":"1676689255580"} 2023-02-18 03:00:55,590 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:00:55,593 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:00:55,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:00:55,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:00:55,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:00:55,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4a54f3fbdf4e594b394fc115482fc120, ASSIGN}] 2023-02-18 03:00:55,600 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4a54f3fbdf4e594b394fc115482fc120, ASSIGN 2023-02-18 03:00:55,602 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4a54f3fbdf4e594b394fc115482fc120, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46341,1676689253059; forceNewPlan=false, retain=false 2023-02-18 03:00:55,754 INFO [jenkins-hbase20:39021] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:00:55,755 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4a54f3fbdf4e594b394fc115482fc120, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:55,756 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689255755"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689255755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689255755"}]},"ts":"1676689255755"} 2023-02-18 03:00:55,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4a54f3fbdf4e594b394fc115482fc120, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:55,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4a54f3fbdf4e594b394fc115482fc120, NAME => 'hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:00:55,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:55,923 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,926 INFO [StoreOpener-4a54f3fbdf4e594b394fc115482fc120-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,928 DEBUG [StoreOpener-4a54f3fbdf4e594b394fc115482fc120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/info 2023-02-18 03:00:55,928 DEBUG [StoreOpener-4a54f3fbdf4e594b394fc115482fc120-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/info 2023-02-18 03:00:55,928 INFO [StoreOpener-4a54f3fbdf4e594b394fc115482fc120-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a54f3fbdf4e594b394fc115482fc120 columnFamilyName info 2023-02-18 03:00:55,929 INFO [StoreOpener-4a54f3fbdf4e594b394fc115482fc120-1] regionserver.HStore(310): Store=4a54f3fbdf4e594b394fc115482fc120/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:55,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:00:55,941 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:55,942 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 4a54f3fbdf4e594b394fc115482fc120; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69932712, jitterRate=0.042078614234924316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:00:55,942 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 4a54f3fbdf4e594b394fc115482fc120: 2023-02-18 03:00:55,944 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120., pid=6, masterSystemTime=1676689255913 2023-02-18 03:00:55,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,949 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:00:55,950 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4a54f3fbdf4e594b394fc115482fc120, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:55,951 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689255950"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689255950"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689255950"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689255950"}]},"ts":"1676689255950"} 2023-02-18 03:00:55,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:00:55,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4a54f3fbdf4e594b394fc115482fc120, server=jenkins-hbase20.apache.org,46341,1676689253059 in 195 msec 2023-02-18 03:00:55,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:00:55,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4a54f3fbdf4e594b394fc115482fc120, ASSIGN in 362 msec 2023-02-18 03:00:55,966 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:00:55,967 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689255966"}]},"ts":"1676689255966"} 2023-02-18 03:00:55,976 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:00:55,980 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:00:55,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 957 msec 2023-02-18 03:00:56,034 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:00:56,035 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:00:56,036 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:00:56,074 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:00:56,095 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:00:56,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-18 03:00:56,109 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:00:56,122 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:00:56,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-18 03:00:56,140 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:00:56,142 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:00:56,142 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.973sec 2023-02-18 03:00:56,145 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:00:56,147 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:00:56,147 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:00:56,148 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39021,1676689252067-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:00:56,150 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39021,1676689252067-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:00:56,157 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ReadOnlyZKClient(139): Connect 0x09970056 to 127.0.0.1:56438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:00:56,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:00:56,161 DEBUG [Listener at localhost.localdomain/40571] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dbdc72e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:00:56,193 DEBUG [hconnection-0x365bdfb8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:00:56,205 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36810, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:00:56,215 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:00:56,216 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:00:56,226 DEBUG [Listener at localhost.localdomain/40571] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:00:56,229 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43638, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:00:56,234 INFO [Listener at localhost.localdomain/40571] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 03:00:56,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-18 03:00:56,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:00:56,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 148.251.75.209:43638 deadline: 1676689316238, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 03:00:56,256 INFO [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 03:00:56,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:00:56,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 03:00:56,274 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:00:56,277 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:00:56,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 03:00:56,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:00:56,318 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,319 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 empty. 2023-02-18 03:00:56,319 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:56,319 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 empty. 2023-02-18 03:00:56,319 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 empty. 2023-02-18 03:00:56,323 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 empty. 2023-02-18 03:00:56,323 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 empty. 2023-02-18 03:00:56,323 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 empty. 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e empty. 2023-02-18 03:00:56,322 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 empty. 2023-02-18 03:00:56,323 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 empty. 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 empty. 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:56,324 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:56,325 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,325 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:56,325 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 03:00:56,343 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 03:00:56,345 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e00d71f6a1ee32bb35f1cdd56c0ffd56, NAME => 'testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,349 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a577f6de7f99d7d58994905f9315064e, NAME => 'testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,350 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e422517004c3dbb0cb18915d918e7406, NAME => 'testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,401 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,402 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e422517004c3dbb0cb18915d918e7406, disabling compactions & flushes 2023-02-18 03:00:56,402 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,402 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,402 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. after waiting 0 ms 2023-02-18 03:00:56,402 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,402 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,402 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:00:56,403 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => cf92b39f548d7531057934283dbb00c9, NAME => 'testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,403 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,404 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a577f6de7f99d7d58994905f9315064e, disabling compactions & flushes 2023-02-18 03:00:56,404 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:56,404 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:56,404 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. after waiting 0 ms 2023-02-18 03:00:56,404 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:56,404 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:56,404 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:00:56,405 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 029f725352138d7ea9db45e81a022538, NAME => 'testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,405 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,406 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e00d71f6a1ee32bb35f1cdd56c0ffd56, disabling compactions & flushes 2023-02-18 03:00:56,406 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,406 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,406 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. after waiting 0 ms 2023-02-18 03:00:56,406 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,406 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,406 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:00:56,407 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => eba8e412537abad8385f60594df5ea41, NAME => 'testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:00:56,436 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing cf92b39f548d7531057934283dbb00c9, disabling compactions & flushes 2023-02-18 03:00:56,437 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. after waiting 0 ms 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,437 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 029f725352138d7ea9db45e81a022538, disabling compactions & flushes 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,437 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:56,437 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing eba8e412537abad8385f60594df5ea41, disabling compactions & flushes 2023-02-18 03:00:56,438 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8c3c65313de4bba554173bf1f16139a0, NAME => 'testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,438 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. after waiting 0 ms 2023-02-18 03:00:56,438 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:56,438 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:56,439 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:56,440 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:56,440 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. after waiting 0 ms 2023-02-18 03:00:56,440 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:00:56,440 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:56,440 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:56,440 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:00:56,441 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1ec6698ba75923360984a0df00eb89d5, NAME => 'testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,441 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92fc0b60871303ea4c879666c381dfa3, NAME => 'testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,463 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8c3c65313de4bba554173bf1f16139a0, disabling compactions & flushes 2023-02-18 03:00:56,464 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. after waiting 0 ms 2023-02-18 03:00:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:56,464 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:56,464 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:00:56,465 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 257de9664e172182d8b7399c286e5260, NAME => 'testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp 2023-02-18 03:00:56,465 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,466 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 1ec6698ba75923360984a0df00eb89d5, disabling compactions & flushes 2023-02-18 03:00:56,466 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:56,466 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:56,466 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. after waiting 0 ms 2023-02-18 03:00:56,466 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:56,466 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:56,466 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:00:56,467 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,467 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 92fc0b60871303ea4c879666c381dfa3, disabling compactions & flushes 2023-02-18 03:00:56,468 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:56,468 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:56,468 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. after waiting 0 ms 2023-02-18 03:00:56,468 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:56,468 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:56,468 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:00:56,486 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,486 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 257de9664e172182d8b7399c286e5260, disabling compactions & flushes 2023-02-18 03:00:56,486 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,486 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,486 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. after waiting 0 ms 2023-02-18 03:00:56,486 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,486 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,487 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:00:56,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:00:56,493 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,493 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,493 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676689256264.029f725352138d7ea9db45e81a022538.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676689256264.eba8e412537abad8385f60594df5ea41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,494 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689256492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689256492"}]},"ts":"1676689256492"} 2023-02-18 03:00:56,571 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 03:00:56,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:00:56,573 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689256573"}]},"ts":"1676689256573"} 2023-02-18 03:00:56,576 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 03:00:56,578 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:00:56,588 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:00:56,588 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:00:56,588 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:00:56,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, ASSIGN}] 2023-02-18 03:00:56,593 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, ASSIGN 2023-02-18 03:00:56,593 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, ASSIGN 2023-02-18 03:00:56,594 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, ASSIGN 2023-02-18 03:00:56,594 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, ASSIGN 2023-02-18 03:00:56,595 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46341,1676689253059; forceNewPlan=false, retain=false 2023-02-18 03:00:56,595 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41935,1676689253107; forceNewPlan=false, retain=false 2023-02-18 03:00:56,595 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41935,1676689253107; forceNewPlan=false, retain=false 2023-02-18 03:00:56,596 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46341,1676689253059; forceNewPlan=false, retain=false 2023-02-18 03:00:56,597 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, ASSIGN 2023-02-18 03:00:56,597 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, ASSIGN 2023-02-18 03:00:56,597 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, ASSIGN 2023-02-18 03:00:56,599 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41935,1676689253107; forceNewPlan=false, retain=false 2023-02-18 03:00:56,599 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46341,1676689253059; forceNewPlan=false, retain=false 2023-02-18 03:00:56,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41935,1676689253107; forceNewPlan=false, retain=false 2023-02-18 03:00:56,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, ASSIGN 2023-02-18 03:00:56,601 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, ASSIGN 2023-02-18 03:00:56,601 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, ASSIGN 2023-02-18 03:00:56,602 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41935,1676689253107; forceNewPlan=false, retain=false 2023-02-18 03:00:56,602 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46341,1676689253059; forceNewPlan=false, retain=false 2023-02-18 03:00:56,602 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46341,1676689253059; forceNewPlan=false, retain=false 2023-02-18 03:00:56,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:00:56,745 INFO [jenkins-hbase20:39021] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 03:00:56,748 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=92fc0b60871303ea4c879666c381dfa3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,748 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e00d71f6a1ee32bb35f1cdd56c0ffd56, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,748 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256748"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256748"}]},"ts":"1676689256748"} 2023-02-18 03:00:56,748 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689256748"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256748"}]},"ts":"1676689256748"} 2023-02-18 03:00:56,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8c3c65313de4bba554173bf1f16139a0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,749 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256748"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256748"}]},"ts":"1676689256748"} 2023-02-18 03:00:56,748 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e422517004c3dbb0cb18915d918e7406, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256748"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256748"}]},"ts":"1676689256748"} 2023-02-18 03:00:56,748 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=029f725352138d7ea9db45e81a022538, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,750 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676689256264.029f725352138d7ea9db45e81a022538.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256748"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256748"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256748"}]},"ts":"1676689256748"} 2023-02-18 03:00:56,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 92fc0b60871303ea4c879666c381dfa3, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:56,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure e00d71f6a1ee32bb35f1cdd56c0ffd56, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:56,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=17, state=RUNNABLE; OpenRegionProcedure 8c3c65313de4bba554173bf1f16139a0, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:56,760 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=257de9664e172182d8b7399c286e5260, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure e422517004c3dbb0cb18915d918e7406, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:56,760 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689256760"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256760"}]},"ts":"1676689256760"} 2023-02-18 03:00:56,762 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a577f6de7f99d7d58994905f9315064e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256762"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256762"}]},"ts":"1676689256762"} 2023-02-18 03:00:56,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 029f725352138d7ea9db45e81a022538, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:00:56,766 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1ec6698ba75923360984a0df00eb89d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,766 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256765"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256765"}]},"ts":"1676689256765"} 2023-02-18 03:00:56,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure 257de9664e172182d8b7399c286e5260, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:00:56,767 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cf92b39f548d7531057934283dbb00c9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,768 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256767"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256767"}]},"ts":"1676689256767"} 2023-02-18 03:00:56,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure a577f6de7f99d7d58994905f9315064e, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:00:56,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 1ec6698ba75923360984a0df00eb89d5, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:00:56,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=eba8e412537abad8385f60594df5ea41, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676689256264.eba8e412537abad8385f60594df5ea41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256770"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689256770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689256770"}]},"ts":"1676689256770"} 2023-02-18 03:00:56,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure cf92b39f548d7531057934283dbb00c9, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:00:56,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure eba8e412537abad8385f60594df5ea41, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:00:56,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e422517004c3dbb0cb18915d918e7406, NAME => 'testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 03:00:56,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,917 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,918 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1 2023-02-18 03:00:56,918 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1 2023-02-18 03:00:56,919 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e422517004c3dbb0cb18915d918e7406 columnFamilyName f1 2023-02-18 03:00:56,919 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(310): Store=e422517004c3dbb0cb18915d918e7406/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,920 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,920 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,921 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:00:56,924 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2 2023-02-18 03:00:56,924 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40480, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:00:56,924 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2 2023-02-18 03:00:56,925 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e422517004c3dbb0cb18915d918e7406 columnFamilyName f2 2023-02-18 03:00:56,926 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(310): Store=e422517004c3dbb0cb18915d918e7406/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:00:56,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 257de9664e172182d8b7399c286e5260, NAME => 'testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 03:00:56,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:56,936 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e422517004c3dbb0cb18915d918e7406 2023-02-18 03:00:56,938 DEBUG [StoreOpener-257de9664e172182d8b7399c286e5260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f1 2023-02-18 03:00:56,938 DEBUG [StoreOpener-257de9664e172182d8b7399c286e5260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f1 2023-02-18 03:00:56,939 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 257de9664e172182d8b7399c286e5260 columnFamilyName f1 2023-02-18 03:00:56,939 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(310): Store=257de9664e172182d8b7399c286e5260/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,940 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:56,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e422517004c3dbb0cb18915d918e7406; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71447855, jitterRate=0.06465600430965424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:56,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:00:56,942 DEBUG [StoreOpener-257de9664e172182d8b7399c286e5260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f2 2023-02-18 03:00:56,942 DEBUG [StoreOpener-257de9664e172182d8b7399c286e5260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f2 2023-02-18 03:00:56,942 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 257de9664e172182d8b7399c286e5260 columnFamilyName f2 2023-02-18 03:00:56,943 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(310): Store=257de9664e172182d8b7399c286e5260/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406., pid=24, masterSystemTime=1676689256908 2023-02-18 03:00:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:56,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e00d71f6a1ee32bb35f1cdd56c0ffd56, NAME => 'testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 03:00:56,948 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e422517004c3dbb0cb18915d918e7406, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,948 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689256948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689256948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689256948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689256948"}]},"ts":"1676689256948"} 2023-02-18 03:00:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:56,952 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 257de9664e172182d8b7399c286e5260 2023-02-18 03:00:56,955 DEBUG [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f1 2023-02-18 03:00:56,955 DEBUG [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f1 2023-02-18 03:00:56,956 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00d71f6a1ee32bb35f1cdd56c0ffd56 columnFamilyName f1 2023-02-18 03:00:56,957 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(310): Store=e00d71f6a1ee32bb35f1cdd56c0ffd56/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-18 03:00:56,958 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure e422517004c3dbb0cb18915d918e7406, server=jenkins-hbase20.apache.org,46341,1676689253059 in 192 msec 2023-02-18 03:00:56,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:56,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, ASSIGN in 369 msec 2023-02-18 03:00:56,961 DEBUG [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f2 2023-02-18 03:00:56,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 257de9664e172182d8b7399c286e5260; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64891979, jitterRate=-0.03303416073322296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:56,961 DEBUG [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f2 2023-02-18 03:00:56,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:00:56,962 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00d71f6a1ee32bb35f1cdd56c0ffd56 columnFamilyName f2 2023-02-18 03:00:56,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260., pid=26, masterSystemTime=1676689256920 2023-02-18 03:00:56,963 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(310): Store=e00d71f6a1ee32bb35f1cdd56c0ffd56/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:56,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:56,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => eba8e412537abad8385f60594df5ea41, NAME => 'testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 03:00:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,969 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=257de9664e172182d8b7399c286e5260, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:56,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,969 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689256969"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689256969"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689256969"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689256969"}]},"ts":"1676689256969"} 2023-02-18 03:00:56,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,970 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,973 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1 2023-02-18 03:00:56,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:56,973 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1 2023-02-18 03:00:56,974 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eba8e412537abad8385f60594df5ea41 columnFamilyName f1 2023-02-18 03:00:56,975 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(310): Store=eba8e412537abad8385f60594df5ea41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,975 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:00:56,979 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2 2023-02-18 03:00:56,979 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2 2023-02-18 03:00:56,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-18 03:00:56,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure 257de9664e172182d8b7399c286e5260, server=jenkins-hbase20.apache.org,41935,1676689253107 in 207 msec 2023-02-18 03:00:56,981 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eba8e412537abad8385f60594df5ea41 columnFamilyName f2 2023-02-18 03:00:56,982 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(310): Store=eba8e412537abad8385f60594df5ea41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:56,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, ASSIGN in 391 msec 2023-02-18 03:00:56,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e00d71f6a1ee32bb35f1cdd56c0ffd56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74961972, jitterRate=0.11702042818069458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:56,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:00:56,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56., pid=22, masterSystemTime=1676689256908 2023-02-18 03:00:56,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:56,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:56,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:56,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 029f725352138d7ea9db45e81a022538, NAME => 'testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 03:00:56,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 029f725352138d7ea9db45e81a022538 2023-02-18 03:00:56,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:56,993 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e00d71f6a1ee32bb35f1cdd56c0ffd56, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:56,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 029f725352138d7ea9db45e81a022538 2023-02-18 03:00:56,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 029f725352138d7ea9db45e81a022538 2023-02-18 03:00:56,993 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689256993"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689256993"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689256993"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689256993"}]},"ts":"1676689256993"} 2023-02-18 03:00:56,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for eba8e412537abad8385f60594df5ea41 2023-02-18 03:00:56,995 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 029f725352138d7ea9db45e81a022538 2023-02-18 03:00:56,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:56,998 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1 2023-02-18 03:00:56,998 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1 2023-02-18 03:00:56,999 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 029f725352138d7ea9db45e81a022538 columnFamilyName f1 2023-02-18 03:00:56,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened eba8e412537abad8385f60594df5ea41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66326853, jitterRate=-0.011652871966362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:56,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:00:57,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41., pid=30, masterSystemTime=1676689256920 2023-02-18 03:00:57,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-18 03:00:57,001 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(310): Store=029f725352138d7ea9db45e81a022538/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure e00d71f6a1ee32bb35f1cdd56c0ffd56, server=jenkins-hbase20.apache.org,46341,1676689253059 in 242 msec 2023-02-18 03:00:57,002 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 029f725352138d7ea9db45e81a022538 2023-02-18 03:00:57,004 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2 2023-02-18 03:00:57,004 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2 2023-02-18 03:00:57,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, ASSIGN in 412 msec 2023-02-18 03:00:57,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:57,005 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 029f725352138d7ea9db45e81a022538 columnFamilyName f2 2023-02-18 03:00:57,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:57,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:57,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf92b39f548d7531057934283dbb00c9, NAME => 'testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 03:00:57,005 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=eba8e412537abad8385f60594df5ea41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:57,006 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676689256264.eba8e412537abad8385f60594df5ea41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257005"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257005"}]},"ts":"1676689257005"} 2023-02-18 03:00:57,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,006 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(310): Store=029f725352138d7ea9db45e81a022538/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:57,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 2023-02-18 03:00:57,009 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 2023-02-18 03:00:57,011 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1 2023-02-18 03:00:57,012 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1 2023-02-18 03:00:57,012 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf92b39f548d7531057934283dbb00c9 columnFamilyName f1 2023-02-18 03:00:57,013 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(310): Store=cf92b39f548d7531057934283dbb00c9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,013 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-18 03:00:57,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure eba8e412537abad8385f60594df5ea41, server=jenkins-hbase20.apache.org,41935,1676689253107 in 235 msec 2023-02-18 03:00:57,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:57,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 029f725352138d7ea9db45e81a022538 2023-02-18 03:00:57,018 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2 2023-02-18 03:00:57,018 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2 2023-02-18 03:00:57,019 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf92b39f548d7531057934283dbb00c9 columnFamilyName f2 2023-02-18 03:00:57,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, ASSIGN in 427 msec 2023-02-18 03:00:57,020 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(310): Store=cf92b39f548d7531057934283dbb00c9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:57,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 029f725352138d7ea9db45e81a022538; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67062046, jitterRate=-6.976425647735596E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:57,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:00:57,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538., pid=25, masterSystemTime=1676689256908 2023-02-18 03:00:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:57,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:57,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:57,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92fc0b60871303ea4c879666c381dfa3, NAME => 'testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 03:00:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,027 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=029f725352138d7ea9db45e81a022538, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:57,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,028 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676689256264.029f725352138d7ea9db45e81a022538.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257027"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257027"}]},"ts":"1676689257027"} 2023-02-18 03:00:57,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for cf92b39f548d7531057934283dbb00c9 2023-02-18 03:00:57,031 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:57,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened cf92b39f548d7531057934283dbb00c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71226604, jitterRate=0.06135910749435425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:57,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:00:57,035 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1 2023-02-18 03:00:57,035 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1 2023-02-18 03:00:57,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-18 03:00:57,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 029f725352138d7ea9db45e81a022538, server=jenkins-hbase20.apache.org,46341,1676689253059 in 268 msec 2023-02-18 03:00:57,036 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92fc0b60871303ea4c879666c381dfa3 columnFamilyName f1 2023-02-18 03:00:57,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9., pid=29, masterSystemTime=1676689256920 2023-02-18 03:00:57,037 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(310): Store=92fc0b60871303ea4c879666c381dfa3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,037 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, ASSIGN in 446 msec 2023-02-18 03:00:57,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:57,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:57,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:57,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ec6698ba75923360984a0df00eb89d5, NAME => 'testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 03:00:57,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:57,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,039 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=cf92b39f548d7531057934283dbb00c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:57,040 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257039"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257039"}]},"ts":"1676689257039"} 2023-02-18 03:00:57,041 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2 2023-02-18 03:00:57,041 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2 2023-02-18 03:00:57,042 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92fc0b60871303ea4c879666c381dfa3 columnFamilyName f2 2023-02-18 03:00:57,043 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(310): Store=92fc0b60871303ea4c879666c381dfa3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,047 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,050 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1 2023-02-18 03:00:57,050 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1 2023-02-18 03:00:57,051 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec6698ba75923360984a0df00eb89d5 columnFamilyName f1 2023-02-18 03:00:57,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-18 03:00:57,052 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(310): Store=1ec6698ba75923360984a0df00eb89d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,052 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure cf92b39f548d7531057934283dbb00c9, server=jenkins-hbase20.apache.org,41935,1676689253107 in 274 msec 2023-02-18 03:00:57,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:57,053 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:00:57,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, ASSIGN in 463 msec 2023-02-18 03:00:57,056 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2 2023-02-18 03:00:57,056 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2 2023-02-18 03:00:57,056 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec6698ba75923360984a0df00eb89d5 columnFamilyName f2 2023-02-18 03:00:57,057 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(310): Store=1ec6698ba75923360984a0df00eb89d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:57,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 92fc0b60871303ea4c879666c381dfa3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70706026, jitterRate=0.05360189080238342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:57,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:00:57,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3., pid=21, masterSystemTime=1676689256908 2023-02-18 03:00:57,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:57,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:57,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:00:57,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:57,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:57,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8c3c65313de4bba554173bf1f16139a0, NAME => 'testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 03:00:57,065 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=92fc0b60871303ea4c879666c381dfa3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:57,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257065"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257065"}]},"ts":"1676689257065"} 2023-02-18 03:00:57,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:57,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:57,068 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1ec6698ba75923360984a0df00eb89d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60664574, jitterRate=-0.09602740406990051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:57,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:00:57,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5., pid=28, masterSystemTime=1676689256920 2023-02-18 03:00:57,070 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1 2023-02-18 03:00:57,071 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1 2023-02-18 03:00:57,071 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c3c65313de4bba554173bf1f16139a0 columnFamilyName f1 2023-02-18 03:00:57,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-18 03:00:57,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 92fc0b60871303ea4c879666c381dfa3, server=jenkins-hbase20.apache.org,46341,1676689253059 in 316 msec 2023-02-18 03:00:57,073 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(310): Store=8c3c65313de4bba554173bf1f16139a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,073 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:57,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:57,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:57,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a577f6de7f99d7d58994905f9315064e, NAME => 'testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 03:00:57,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:00:57,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,076 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1ec6698ba75923360984a0df00eb89d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:57,076 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257075"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257075"}]},"ts":"1676689257075"} 2023-02-18 03:00:57,077 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2 2023-02-18 03:00:57,077 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2 2023-02-18 03:00:57,077 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c3c65313de4bba554173bf1f16139a0 columnFamilyName f2 2023-02-18 03:00:57,077 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, ASSIGN in 484 msec 2023-02-18 03:00:57,078 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(310): Store=8c3c65313de4bba554173bf1f16139a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,082 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1 2023-02-18 03:00:57,082 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1 2023-02-18 03:00:57,083 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a577f6de7f99d7d58994905f9315064e columnFamilyName f1 2023-02-18 03:00:57,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-18 03:00:57,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 1ec6698ba75923360984a0df00eb89d5, server=jenkins-hbase20.apache.org,41935,1676689253107 in 309 msec 2023-02-18 03:00:57,084 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(310): Store=a577f6de7f99d7d58994905f9315064e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,084 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:57,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, ASSIGN in 495 msec 2023-02-18 03:00:57,087 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2 2023-02-18 03:00:57,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:00:57,087 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2 2023-02-18 03:00:57,087 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a577f6de7f99d7d58994905f9315064e columnFamilyName f2 2023-02-18 03:00:57,088 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(310): Store=a577f6de7f99d7d58994905f9315064e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:00:57,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:00:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for a577f6de7f99d7d58994905f9315064e 2023-02-18 03:00:57,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:57,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:00:57,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8c3c65313de4bba554173bf1f16139a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67568144, jitterRate=0.0068438053131103516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:57,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:00:57,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened a577f6de7f99d7d58994905f9315064e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66998757, jitterRate=-0.0016407221555709839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:00:57,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:00:57,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0., pid=23, masterSystemTime=1676689256908 2023-02-18 03:00:57,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e., pid=27, masterSystemTime=1676689256920 2023-02-18 03:00:57,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:57,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:57,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8c3c65313de4bba554173bf1f16139a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:57,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:57,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:57,109 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257108"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257108"}]},"ts":"1676689257108"} 2023-02-18 03:00:57,109 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a577f6de7f99d7d58994905f9315064e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:57,110 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689257109"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689257109"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689257109"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689257109"}]},"ts":"1676689257109"} 2023-02-18 03:00:57,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=17 2023-02-18 03:00:57,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=17, state=SUCCESS; OpenRegionProcedure 8c3c65313de4bba554173bf1f16139a0, server=jenkins-hbase20.apache.org,46341,1676689253059 in 352 msec 2023-02-18 03:00:57,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-18 03:00:57,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure a577f6de7f99d7d58994905f9315064e, server=jenkins-hbase20.apache.org,41935,1676689253107 in 345 msec 2023-02-18 03:00:57,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, ASSIGN in 526 msec 2023-02-18 03:00:57,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=10 2023-02-18 03:00:57,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, ASSIGN in 527 msec 2023-02-18 03:00:57,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:00:57,121 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689257120"}]},"ts":"1676689257120"} 2023-02-18 03:00:57,123 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 03:00:57,125 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:00:57,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 856 msec 2023-02-18 03:00:57,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:00:57,434 INFO [Listener at localhost.localdomain/40571] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 03:00:57,434 DEBUG [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 03:00:57,436 INFO [Listener at localhost.localdomain/40571] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:00:57,443 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 03:00:57,444 INFO [Listener at localhost.localdomain/40571] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:00:57,444 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 03:00:57,444 INFO [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:00:57,579 DEBUG [hconnection-0x365bdfb8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:00:57,630 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40494, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:00:57,662 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41935] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:57,664 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46341] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:57,931 INFO [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:00:57,934 INFO [Listener at localhost.localdomain/40571] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:00:57,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:00:57,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689257944 (current time:1676689257944). 2023-02-18 03:00:57,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:00:57,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] zookeeper.ReadOnlyZKClient(139): Connect 0x6ca1768c to 127.0.0.1:56438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:00:57,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1336f901, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:00:57,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:00:57,958 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:00:57,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ca1768c to 127.0.0.1:56438 2023-02-18 03:00:57,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:00:57,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:00:57,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:00:57,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:00:57,988 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:00:57,989 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676689857989 2023-02-18 03:00:57,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:00:57,993 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 03:00:57,994 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:00:57,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:00:57,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 16 msec 2023-02-18 03:00:57,998 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:00:57,998 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:00:57,998 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:00:57,999 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676689857999 2023-02-18 03:00:58,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-18 03:00:58,063 INFO [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-18 03:00:58,063 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:00:58,064 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-18 03:00:58,064 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 03:00:58,065 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,065 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:58,066 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:00:58,066 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:00:58,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:00:58,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:00:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:00:58,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:00:58,066 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:58,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:58,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,067 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,067 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-18 03:00:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:58,068 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,068 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:00:58,068 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 03:00:58,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-18 03:00:58,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-18 03:00:58,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:58,071 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 03:00:58,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-18 03:00:58,079 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-18 03:00:58,079 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:00:58,079 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46341,1676689253059' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-18 03:00:58,080 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41935,1676689253107' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-18 03:00:58,083 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,083 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,083 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,083 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:00:58,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:00:58,087 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,087 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,087 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:00:58,087 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:00:58,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:00:58,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:00:58,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:00:58,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41935,1676689253107' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-18 03:00:58,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75ab4940[Count = 1] remaining members to acquire global barrier 2023-02-18 03:00:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:00:58,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:00:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:00:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:00:58,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:00:58,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46341,1676689253059' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-18 03:00:58,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75ab4940[Count = 0] remaining members to acquire global barrier 2023-02-18 03:00:58,098 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:00:58,099 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 03:00:58,099 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:58,101 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 03:00:58,101 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 03:00:58,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:00:58,103 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:00:58,103 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,103 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:00:58,103 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:58,103 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. started... 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. started... 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. started... 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:58,104 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. started... 2023-02-18 03:00:58,105 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 03:00:58,105 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:58,105 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 03:00:58,105 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:00:58,105 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. started... 2023-02-18 03:00:58,105 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:58,105 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:00:58,106 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. started... 2023-02-18 03:00:58,106 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 92fc0b60871303ea4c879666c381dfa3 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 03:00:58,106 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8c3c65313de4bba554173bf1f16139a0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:00:58,108 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1ec6698ba75923360984a0df00eb89d5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:00:58,108 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HRegion(2744): Flushing eba8e412537abad8385f60594df5ea41 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:00:58,109 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:00:58,109 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:00:58,110 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,110 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,116 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,116 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,136 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:00:58,136 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:00:58,137 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:00:58,137 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:00:58,159 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. completed. 2023-02-18 03:00:58,159 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:00:58,160 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:58,160 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 03:00:58,160 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. completed. 2023-02-18 03:00:58,160 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. started... 2023-02-18 03:00:58,161 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:00:58,161 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:58,161 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 03:00:58,162 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. started... 2023-02-18 03:00:58,162 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a577f6de7f99d7d58994905f9315064e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:00:58,162 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 029f725352138d7ea9db45e81a022538 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:00:58,308 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:00:58,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:00:58,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:00:58,310 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 03:00:58,357 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f1/1dc69d2f471846519261b6c797e73dca 2023-02-18 03:00:58,417 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f1/fb33309ffadc4c87a8061a318bd52d84 2023-02-18 03:00:58,417 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f1/5f7c75c1db2141aeb25f9e57fa76a271 2023-02-18 03:00:58,422 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f1/a63f97b509234236b8ebc2f100b7b31f 2023-02-18 03:00:58,525 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f2/8734215aa5704cc1b071455e2d44bfc0 2023-02-18 03:00:58,527 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f2/81b764b8be974c30a0beac803607ebd2 2023-02-18 03:00:58,528 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f2/68fee5176f3f4ec7903eb1fc9bb3c76b 2023-02-18 03:00:58,548 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f1/1dc69d2f471846519261b6c797e73dca as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/1dc69d2f471846519261b6c797e73dca 2023-02-18 03:00:58,550 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f1/fb33309ffadc4c87a8061a318bd52d84 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/fb33309ffadc4c87a8061a318bd52d84 2023-02-18 03:00:58,553 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f1/5f7c75c1db2141aeb25f9e57fa76a271 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/5f7c75c1db2141aeb25f9e57fa76a271 2023-02-18 03:00:58,565 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/5f7c75c1db2141aeb25f9e57fa76a271, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,567 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f2/68fee5176f3f4ec7903eb1fc9bb3c76b as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/68fee5176f3f4ec7903eb1fc9bb3c76b 2023-02-18 03:00:58,569 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/fb33309ffadc4c87a8061a318bd52d84, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,572 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f2/8734215aa5704cc1b071455e2d44bfc0 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/8734215aa5704cc1b071455e2d44bfc0 2023-02-18 03:00:58,580 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/1dc69d2f471846519261b6c797e73dca, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,588 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f2/81b764b8be974c30a0beac803607ebd2 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/81b764b8be974c30a0beac803607ebd2 2023-02-18 03:00:58,598 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/68fee5176f3f4ec7903eb1fc9bb3c76b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,599 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/81b764b8be974c30a0beac803607ebd2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,600 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/8734215aa5704cc1b071455e2d44bfc0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,600 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1ec6698ba75923360984a0df00eb89d5 in 492ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,600 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a577f6de7f99d7d58994905f9315064e in 438ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,601 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 029f725352138d7ea9db45e81a022538 in 439ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,601 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 03:00:58,601 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 03:00:58,601 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 03:00:58,605 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:00:58,605 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,605 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,606 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/5f7c75c1db2141aeb25f9e57fa76a271] hfiles 2023-02-18 03:00:58,606 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/5f7c75c1db2141aeb25f9e57fa76a271 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/1dc69d2f471846519261b6c797e73dca] hfiles 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/1dc69d2f471846519261b6c797e73dca for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/fb33309ffadc4c87a8061a318bd52d84] hfiles 2023-02-18 03:00:58,607 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/fb33309ffadc4c87a8061a318bd52d84 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,609 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/81b764b8be974c30a0beac803607ebd2] hfiles 2023-02-18 03:00:58,609 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/8734215aa5704cc1b071455e2d44bfc0] hfiles 2023-02-18 03:00:58,609 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/68fee5176f3f4ec7903eb1fc9bb3c76b] hfiles 2023-02-18 03:00:58,609 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/8734215aa5704cc1b071455e2d44bfc0 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,609 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/81b764b8be974c30a0beac803607ebd2 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,609 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/68fee5176f3f4ec7903eb1fc9bb3c76b for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,611 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:00:58,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:00:58,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:00:58,613 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 03:00:58,639 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. completed. 2023-02-18 03:00:58,639 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:00:58,639 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:58,639 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 03:00:58,640 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. started... 2023-02-18 03:00:58,640 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. completed. 2023-02-18 03:00:58,640 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:00:58,640 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:58,640 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e422517004c3dbb0cb18915d918e7406 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 03:00:58,640 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. started... 2023-02-18 03:00:58,640 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 03:00:58,641 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cf92b39f548d7531057934283dbb00c9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:00:58,647 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. completed. 2023-02-18 03:00:58,647 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:00:58,647 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 03:00:58,663 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f1/4af0726d3bce4c46a4439481635ae655 2023-02-18 03:00:58,675 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f1/b715697c192f4c46945c06590d31efb0 2023-02-18 03:00:58,703 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f2/dd4968269c764edcaf88d83b558c82da 2023-02-18 03:00:58,712 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f2/3164bcb4705c4aed9f23771ade8827c2 2023-02-18 03:00:58,712 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f1/4af0726d3bce4c46a4439481635ae655 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4af0726d3bce4c46a4439481635ae655 2023-02-18 03:00:58,721 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f1/b715697c192f4c46945c06590d31efb0 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/b715697c192f4c46945c06590d31efb0 2023-02-18 03:00:58,722 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4af0726d3bce4c46a4439481635ae655, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:00:58,724 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f2/dd4968269c764edcaf88d83b558c82da as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/dd4968269c764edcaf88d83b558c82da 2023-02-18 03:00:58,731 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/b715697c192f4c46945c06590d31efb0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,731 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/dd4968269c764edcaf88d83b558c82da, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:00:58,732 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f2/3164bcb4705c4aed9f23771ade8827c2 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/3164bcb4705c4aed9f23771ade8827c2 2023-02-18 03:00:58,733 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e422517004c3dbb0cb18915d918e7406 in 93ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,733 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:00:58,733 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,733 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,733 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4af0726d3bce4c46a4439481635ae655] hfiles 2023-02-18 03:00:58,733 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4af0726d3bce4c46a4439481635ae655 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,733 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/dd4968269c764edcaf88d83b558c82da] hfiles 2023-02-18 03:00:58,734 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/dd4968269c764edcaf88d83b558c82da for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,743 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/3164bcb4705c4aed9f23771ade8827c2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,744 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. completed. 2023-02-18 03:00:58,744 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:00:58,744 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 03:00:58,744 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cf92b39f548d7531057934283dbb00c9 in 103ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,744 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:00:58,745 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,745 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,745 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/b715697c192f4c46945c06590d31efb0] hfiles 2023-02-18 03:00:58,745 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/b715697c192f4c46945c06590d31efb0 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,745 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/3164bcb4705c4aed9f23771ade8827c2] hfiles 2023-02-18 03:00:58,745 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/3164bcb4705c4aed9f23771ade8827c2 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,753 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. completed. 2023-02-18 03:00:58,753 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:00:58,753 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 03:00:58,797 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f1/bfbca279176d40b4b6ea1240e3e7cc61 2023-02-18 03:00:58,810 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f1/7874eaddcc314fa0905d166a6e849276 2023-02-18 03:00:58,827 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f2/8faad0a59a5e46daaa2f9d75aa6352bf 2023-02-18 03:00:58,838 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f1/bfbca279176d40b4b6ea1240e3e7cc61 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/bfbca279176d40b4b6ea1240e3e7cc61 2023-02-18 03:00:58,842 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f2/d2a7dd94c9454b6da6a8e00506f1aea5 2023-02-18 03:00:58,846 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/bfbca279176d40b4b6ea1240e3e7cc61, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:00:58,848 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f2/8faad0a59a5e46daaa2f9d75aa6352bf as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/8faad0a59a5e46daaa2f9d75aa6352bf 2023-02-18 03:00:58,850 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f1/7874eaddcc314fa0905d166a6e849276 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/7874eaddcc314fa0905d166a6e849276 2023-02-18 03:00:58,854 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/8faad0a59a5e46daaa2f9d75aa6352bf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:00:58,856 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 92fc0b60871303ea4c879666c381dfa3 in 749ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/bfbca279176d40b4b6ea1240e3e7cc61] hfiles 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/bfbca279176d40b4b6ea1240e3e7cc61 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/8faad0a59a5e46daaa2f9d75aa6352bf] hfiles 2023-02-18 03:00:58,856 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/8faad0a59a5e46daaa2f9d75aa6352bf for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,857 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/7874eaddcc314fa0905d166a6e849276, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,859 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f2/d2a7dd94c9454b6da6a8e00506f1aea5 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/d2a7dd94c9454b6da6a8e00506f1aea5 2023-02-18 03:00:58,865 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. completed. 2023-02-18 03:00:58,865 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:00:58,865 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 03:00:58,867 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/d2a7dd94c9454b6da6a8e00506f1aea5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,868 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8c3c65313de4bba554173bf1f16139a0 in 762ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/7874eaddcc314fa0905d166a6e849276] hfiles 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/7874eaddcc314fa0905d166a6e849276 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/d2a7dd94c9454b6da6a8e00506f1aea5] hfiles 2023-02-18 03:00:58,869 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/d2a7dd94c9454b6da6a8e00506f1aea5 for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,880 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. completed. 2023-02-18 03:00:58,880 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:00:58,880 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 03:00:58,880 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 03:00:58,880 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,880 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-18 03:00:58,880 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,46341,1676689253059' in zk 2023-02-18 03:00:58,882 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,882 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-18 03:00:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:00:58,883 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:00:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:00:58,883 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-18 03:00:58,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:00:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:00:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:00:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,46341,1676689253059': 2023-02-18 03:00:58,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46341,1676689253059' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 03:00:58,923 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f2/59595524e0904bb5a20b35d9b1d7dc6a 2023-02-18 03:00:58,932 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f1/a63f97b509234236b8ebc2f100b7b31f as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/a63f97b509234236b8ebc2f100b7b31f 2023-02-18 03:00:58,940 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/a63f97b509234236b8ebc2f100b7b31f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,941 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f2/59595524e0904bb5a20b35d9b1d7dc6a as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/59595524e0904bb5a20b35d9b1d7dc6a 2023-02-18 03:00:58,949 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/59595524e0904bb5a20b35d9b1d7dc6a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:00:58,951 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for eba8e412537abad8385f60594df5ea41 in 842ms, sequenceid=5, compaction requested=false 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/a63f97b509234236b8ebc2f100b7b31f] hfiles 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/a63f97b509234236b8ebc2f100b7b31f for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/59595524e0904bb5a20b35d9b1d7dc6a] hfiles 2023-02-18 03:00:58,951 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/59595524e0904bb5a20b35d9b1d7dc6a for snapshot=testWithMapReduceMultiRegion 2023-02-18 03:00:58,963 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. completed. 2023-02-18 03:00:58,964 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:00:58,964 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 03:00:58,964 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 03:00:58,964 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,964 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-18 03:00:58,964 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,41935,1676689253107' in zk 2023-02-18 03:00:58,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,965 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-18 03:00:58,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:00:58,965 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:00:58,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:00:58,965 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-18 03:00:58,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:00:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:00:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:00:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,41935,1676689253107': 2023-02-18 03:00:58,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41935,1676689253107' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 03:00:58,969 INFO [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-18 03:00:58,969 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:00:58,969 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:00:58,969 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-18 03:00:58,969 INFO [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:00:58,981 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:00:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:00:58,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:00:58,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:00:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:00:58,982 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:00:58,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:00:58,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:00:58,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:00:58,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,983 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:58,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:00:58,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:00:58,985 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-18 03:00:58,985 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:58,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:59,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:00:59,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:00:59,002 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-18 03:00:59,001 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:59,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-18 03:00:59,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:00:59,001 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:00:59,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:00:59,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:00:59,002 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-18 03:00:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:00:59,003 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:00:59,003 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:59,003 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:00:59,003 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-18 03:00:59,003 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-18 03:00:59,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:00:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:00:59,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 03:00:59,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-18 03:00:59,114 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:00:59,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:00:59,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:00:59,117 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-18 03:00:59,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-18 03:00:59,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 03:00:59,524 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-18 03:00:59,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676689257993Consolidate snapshot: testWithMapReduceMultiRegion at 1676689259002 (+1009 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676689259002Writing data manifest for testWithMapReduceMultiRegion at 1676689259046 (+44 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676689259063 (+17 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676689259524 (+461 ms) 2023-02-18 03:00:59,526 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:00:59,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5310 sec 2023-02-18 03:01:00,117 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:00,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:00,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:00,119 INFO [Listener at localhost.localdomain/40571] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:00,133 INFO [Listener at localhost.localdomain/40571] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:00,145 INFO [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:00,219 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41935] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:00,222 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46341] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:00,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-18 03:01:00,352 INFO [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:00,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:00,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 03:01:00,378 INFO [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 03:01:00,378 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:00,379 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 03:01:00,379 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 03:01:00,380 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,380 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,381 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:00,381 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:00,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:00,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:00,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:00,381 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 03:01:00,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 03:01:00,385 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,385 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 03:01:00,385 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,386 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,386 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:00,387 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 03:01:00,387 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:00,391 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 03:01:00,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 03:01:00,392 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 03:01:00,393 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:00,399 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 03:01:00,399 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:00,399 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. started... 2023-02-18 03:01:00,399 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:00,399 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. started... 2023-02-18 03:01:00,400 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:01:00,400 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:00,400 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 03:01:00,400 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1ec6698ba75923360984a0df00eb89d5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:00,400 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:00,400 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:00,400 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. started... 2023-02-18 03:01:00,400 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. started... 2023-02-18 03:01:00,400 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8c3c65313de4bba554173bf1f16139a0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:00,400 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 92fc0b60871303ea4c879666c381dfa3 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 03:01:00,400 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:00,401 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:00,401 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. started... 2023-02-18 03:01:00,402 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing eba8e412537abad8385f60594df5ea41 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:00,403 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 03:01:00,403 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:00,403 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:00,403 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 03:01:00,403 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. started... 2023-02-18 03:01:00,405 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a577f6de7f99d7d58994905f9315064e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:00,403 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:00,415 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. started... 2023-02-18 03:01:00,415 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:01:00,415 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:00,415 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:00,415 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. started... 2023-02-18 03:01:00,415 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 029f725352138d7ea9db45e81a022538 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:00,415 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 03:01:00,484 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 03:01:00,485 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 03:01:00,498 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f1/62f7df459df942bb81203a735965f161 2023-02-18 03:01:00,505 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f1/81379d4a1f33448fa485bc97f91d61d9 2023-02-18 03:01:00,507 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f1/d544f6f24a0f44f4ab9179a05cc5d7c7 2023-02-18 03:01:00,521 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f1/14cc1f5aa6c944f4a1aac122a9b06d1f 2023-02-18 03:01:00,523 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f1/1fb935bc3a3f4b8180a229aaeef73e84 2023-02-18 03:01:00,550 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f2/457dcedcbf6d459c8a8da239b21023c3 2023-02-18 03:01:00,557 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f1/62f7df459df942bb81203a735965f161 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/62f7df459df942bb81203a735965f161 2023-02-18 03:01:00,560 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f2/e56a0855699a4367aabe91bf51c81b5d 2023-02-18 03:01:00,567 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f1/81379d4a1f33448fa485bc97f91d61d9 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/81379d4a1f33448fa485bc97f91d61d9 2023-02-18 03:01:00,571 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f2/9a35547df5af4637989f0f9f2ac2b661 2023-02-18 03:01:00,572 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f2/876ee038f3024e75a20c473707a3326f 2023-02-18 03:01:00,574 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/81379d4a1f33448fa485bc97f91d61d9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,575 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/.tmp/f2/e56a0855699a4367aabe91bf51c81b5d as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/e56a0855699a4367aabe91bf51c81b5d 2023-02-18 03:01:00,575 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f2/4c4c535cdfad426f8c71c570974093ad 2023-02-18 03:01:00,576 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/62f7df459df942bb81203a735965f161, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,577 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/.tmp/f2/457dcedcbf6d459c8a8da239b21023c3 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/457dcedcbf6d459c8a8da239b21023c3 2023-02-18 03:01:00,582 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f1/14cc1f5aa6c944f4a1aac122a9b06d1f as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/14cc1f5aa6c944f4a1aac122a9b06d1f 2023-02-18 03:01:00,583 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f1/d544f6f24a0f44f4ab9179a05cc5d7c7 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/d544f6f24a0f44f4ab9179a05cc5d7c7 2023-02-18 03:01:00,586 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/e56a0855699a4367aabe91bf51c81b5d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,587 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a577f6de7f99d7d58994905f9315064e in 182ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,587 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f1/1fb935bc3a3f4b8180a229aaeef73e84 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/1fb935bc3a3f4b8180a229aaeef73e84 2023-02-18 03:01:00,587 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:01:00,587 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:00,587 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 03:01:00,587 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:00,587 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. started... 2023-02-18 03:01:00,587 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cf92b39f548d7531057934283dbb00c9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:00,590 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/457dcedcbf6d459c8a8da239b21023c3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,591 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1ec6698ba75923360984a0df00eb89d5 in 192ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,592 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:01:00,592 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:00,592 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 03:01:00,594 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/d544f6f24a0f44f4ab9179a05cc5d7c7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,595 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/14cc1f5aa6c944f4a1aac122a9b06d1f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:00,596 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/.tmp/f2/876ee038f3024e75a20c473707a3326f as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/876ee038f3024e75a20c473707a3326f 2023-02-18 03:01:00,597 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/.tmp/f2/9a35547df5af4637989f0f9f2ac2b661 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/9a35547df5af4637989f0f9f2ac2b661 2023-02-18 03:01:00,599 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/1fb935bc3a3f4b8180a229aaeef73e84, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,601 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/.tmp/f2/4c4c535cdfad426f8c71c570974093ad as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/4c4c535cdfad426f8c71c570974093ad 2023-02-18 03:01:00,614 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/9a35547df5af4637989f0f9f2ac2b661, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,615 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8c3c65313de4bba554173bf1f16139a0 in 215ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,615 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:01:00,615 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:00,616 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:00,616 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 03:01:00,616 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. started... 2023-02-18 03:01:00,616 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/4c4c535cdfad426f8c71c570974093ad, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,616 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e422517004c3dbb0cb18915d918e7406 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 03:01:00,617 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 029f725352138d7ea9db45e81a022538 in 202ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,617 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:01:00,617 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:00,617 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 03:01:00,621 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/876ee038f3024e75a20c473707a3326f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:00,622 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 92fc0b60871303ea4c879666c381dfa3 in 222ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,622 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:01:00,622 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:00,622 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 03:01:00,637 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f1/6f03e74973af45278883d213d06d1343 2023-02-18 03:01:00,643 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f1/4ab9257b07eb44cbbc5249130d83e4b1 2023-02-18 03:01:00,665 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f2/ef12ed07d610454bb7afefca3f386fff 2023-02-18 03:01:00,665 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f2/24afd32ed4024600830b65a33af0c46c 2023-02-18 03:01:00,671 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f1/6f03e74973af45278883d213d06d1343 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/6f03e74973af45278883d213d06d1343 2023-02-18 03:01:00,671 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f1/4ab9257b07eb44cbbc5249130d83e4b1 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4ab9257b07eb44cbbc5249130d83e4b1 2023-02-18 03:01:00,677 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4ab9257b07eb44cbbc5249130d83e4b1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:00,677 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/6f03e74973af45278883d213d06d1343, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,678 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/.tmp/f2/ef12ed07d610454bb7afefca3f386fff as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/ef12ed07d610454bb7afefca3f386fff 2023-02-18 03:01:00,678 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/.tmp/f2/24afd32ed4024600830b65a33af0c46c as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/24afd32ed4024600830b65a33af0c46c 2023-02-18 03:01:00,685 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/ef12ed07d610454bb7afefca3f386fff, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,685 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cf92b39f548d7531057934283dbb00c9 in 98ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,686 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:01:00,686 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:00,686 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 03:01:00,687 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/24afd32ed4024600830b65a33af0c46c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:00,688 INFO [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e422517004c3dbb0cb18915d918e7406 in 72ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,688 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:01:00,688 DEBUG [rs(jenkins-hbase20.apache.org,46341,1676689253059)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:00,688 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 03:01:00,689 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 03:01:00,689 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,689 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 03:01:00,689 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46341,1676689253059' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 03:01:00,691 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,691 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:00,691 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:00,691 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:00,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46341,1676689253059' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 03:01:00,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3831f3d0[Count = 1] remaining members to acquire global barrier 2023-02-18 03:01:00,898 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f1/57d019f4ca3443a3a6d4ae37f77be221 2023-02-18 03:01:00,913 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f2/51c790d3bc0c4163b908e9b3b8eb2bce 2023-02-18 03:01:00,919 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f1/57d019f4ca3443a3a6d4ae37f77be221 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/57d019f4ca3443a3a6d4ae37f77be221 2023-02-18 03:01:00,925 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/57d019f4ca3443a3a6d4ae37f77be221, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,926 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/.tmp/f2/51c790d3bc0c4163b908e9b3b8eb2bce as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/51c790d3bc0c4163b908e9b3b8eb2bce 2023-02-18 03:01:00,932 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/51c790d3bc0c4163b908e9b3b8eb2bce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:00,933 INFO [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for eba8e412537abad8385f60594df5ea41 in 531ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:00,933 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:01:00,933 DEBUG [rs(jenkins-hbase20.apache.org,41935,1676689253107)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:00,933 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 03:01:00,933 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 03:01:00,933 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,933 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 03:01:00,933 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41935,1676689253107' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 03:01:00,934 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,934 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:00,935 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:00,935 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:00,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:00,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41935,1676689253107' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 03:01:00,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3831f3d0[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:00,937 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 03:01:00,937 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,938 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 03:01:00,938 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 03:01:00,939 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,939 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 03:01:00,939 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,46341,1676689253059' in zk 2023-02-18 03:01:00,938 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 03:01:00,939 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,41935,1676689253107' in zk 2023-02-18 03:01:00,939 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,939 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:00,940 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 03:01:00,940 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,940 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:00,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:00,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:00,940 DEBUG [member: 'jenkins-hbase20.apache.org,46341,1676689253059' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 03:01:00,941 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,941 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 03:01:00,941 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:00,941 DEBUG [member: 'jenkins-hbase20.apache.org,41935,1676689253107' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 03:01:00,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:00,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:00,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,46341,1676689253059': 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46341,1676689253059' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:00,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:00,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,41935,1676689253107': 2023-02-18 03:01:00,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41935,1676689253107' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 03:01:00,948 INFO [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 03:01:00,948 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:00,949 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:00,949 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 03:01:00,949 INFO [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:00,950 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,950 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,950 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:00,950 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:00,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:00,951 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,950 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:00,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:00,951 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,953 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:00,953 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,963 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:00,963 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,963 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:00,964 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,964 DEBUG [(jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:00,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 03:01:00,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:00,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:00,963 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:00,964 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:00,964 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:00,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:00,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:00,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:00,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:00,965 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:00,966 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:00,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:00,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:00,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:00,966 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:01,067 DEBUG [Listener at localhost.localdomain/40571] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:01,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:01,156 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop-7277223502835209657.jar 2023-02-18 03:01:01,174 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676689257944 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:01,175 DEBUG [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce 2023-02-18 03:01:01,176 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:01,176 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:01,176 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: 257de9664e172182d8b7399c286e5260 2023-02-18 03:01:01,176 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:01,176 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: 029f725352138d7ea9db45e81a022538 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(239): region to add: e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=1ec6698ba75923360984a0df00eb89d5 as 1ec6698ba75923360984a0df00eb89d5 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=92fc0b60871303ea4c879666c381dfa3 as 92fc0b60871303ea4c879666c381dfa3 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=257de9664e172182d8b7399c286e5260 as 257de9664e172182d8b7399c286e5260 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=eba8e412537abad8385f60594df5ea41 as eba8e412537abad8385f60594df5ea41 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=a577f6de7f99d7d58994905f9315064e as a577f6de7f99d7d58994905f9315064e in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,177 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=8c3c65313de4bba554173bf1f16139a0 as 8c3c65313de4bba554173bf1f16139a0 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,178 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=e00d71f6a1ee32bb35f1cdd56c0ffd56 as e00d71f6a1ee32bb35f1cdd56c0ffd56 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,178 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=029f725352138d7ea9db45e81a022538 as 029f725352138d7ea9db45e81a022538 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,178 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=cf92b39f548d7531057934283dbb00c9 as cf92b39f548d7531057934283dbb00c9 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,178 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(585): clone region=e422517004c3dbb0cb18915d918e7406 as e422517004c3dbb0cb18915d918e7406 in snapshot testWithMapReduceMultiRegion 2023-02-18 03:01:01,181 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => a577f6de7f99d7d58994905f9315064e, NAME => 'testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,181 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => eba8e412537abad8385f60594df5ea41, NAME => 'testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,181 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 257de9664e172182d8b7399c286e5260, NAME => 'testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,181 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 92fc0b60871303ea4c879666c381dfa3, NAME => 'testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,181 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 029f725352138d7ea9db45e81a022538, NAME => 'testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,182 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e00d71f6a1ee32bb35f1cdd56c0ffd56, NAME => 'testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,182 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1ec6698ba75923360984a0df00eb89d5, NAME => 'testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,182 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8c3c65313de4bba554173bf1f16139a0, NAME => 'testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,211 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,212 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5f7c75c1db2141aeb25f9e57fa76a271 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,223 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,223 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,224 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb33309ffadc4c87a8061a318bd52d84 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,224 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1dc69d2f471846519261b6c797e73dca from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,231 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,231 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,231 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7874eaddcc314fa0905d166a6e849276 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,231 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 68fee5176f3f4ec7903eb1fc9bb3c76b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,231 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e00d71f6a1ee32bb35f1cdd56c0ffd56, disabling compactions & flushes 2023-02-18 03:01:01,231 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:01,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:01,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. after waiting 0 ms 2023-02-18 03:01:01,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:01,232 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:01,232 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:01:01,232 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => cf92b39f548d7531057934283dbb00c9, NAME => 'testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,233 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 81b764b8be974c30a0beac803607ebd2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing a577f6de7f99d7d58994905f9315064e, disabling compactions & flushes 2023-02-18 03:01:01,239 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:01,239 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:01,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. after waiting 0 ms 2023-02-18 03:01:01,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:01,240 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:01,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:01:01,240 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => e422517004c3dbb0cb18915d918e7406, NAME => 'testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,243 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,244 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bfbca279176d40b4b6ea1240e3e7cc61 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 1ec6698ba75923360984a0df00eb89d5, disabling compactions & flushes 2023-02-18 03:01:01,251 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:01,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:01,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. after waiting 0 ms 2023-02-18 03:01:01,251 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2a7dd94c9454b6da6a8e00506f1aea5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:01,251 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:01,251 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:01:01,255 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8734215aa5704cc1b071455e2d44bfc0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,255 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8faad0a59a5e46daaa2f9d75aa6352bf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8c3c65313de4bba554173bf1f16139a0, disabling compactions & flushes 2023-02-18 03:01:01,262 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 92fc0b60871303ea4c879666c381dfa3, disabling compactions & flushes 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. after waiting 0 ms 2023-02-18 03:01:01,262 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 029f725352138d7ea9db45e81a022538, disabling compactions & flushes 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:01,262 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:01,262 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:01,263 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. after waiting 0 ms 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. after waiting 0 ms 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:01:01,263 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:01:01,263 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:01,263 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:01:01,266 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,266 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4af0726d3bce4c46a4439481635ae655 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,269 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd4968269c764edcaf88d83b558c82da from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,269 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,269 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b715697c192f4c46945c06590d31efb0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,275 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3164bcb4705c4aed9f23771ade8827c2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,275 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing e422517004c3dbb0cb18915d918e7406, disabling compactions & flushes 2023-02-18 03:01:01,275 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:01,276 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:01,276 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. after waiting 0 ms 2023-02-18 03:01:01,276 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:01,276 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:01,276 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:01:01,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing cf92b39f548d7531057934283dbb00c9, disabling compactions & flushes 2023-02-18 03:01:01,278 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:01,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:01,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. after waiting 0 ms 2023-02-18 03:01:01,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:01,278 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:01,278 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:01:01,602 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,602 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a63f97b509234236b8ebc2f100b7b31f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,605 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59595524e0904bb5a20b35d9b1d7dc6a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-18 03:01:01,608 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing eba8e412537abad8385f60594df5ea41, disabling compactions & flushes 2023-02-18 03:01:01,608 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:01,608 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:01,608 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. after waiting 0 ms 2023-02-18 03:01:01,608 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:01,608 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:01,608 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:01:01,628 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:01,628 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 257de9664e172182d8b7399c286e5260, disabling compactions & flushes 2023-02-18 03:01:01,628 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:01,628 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:01,629 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. after waiting 0 ms 2023-02-18 03:01:01,629 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:01,629 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:01,629 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:01:01,629 INFO [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676689257944 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:01,629 DEBUG [Listener at localhost.localdomain/40571] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,629 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a 2023-02-18 03:01:01,630 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:01,631 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:01,631 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 03:01:01,632 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------029f725352138d7ea9db45e81a022538/ 2023-02-18 03:01:01,632 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,632 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,633 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=029f725352138d7ea9db45e81a022538-fb33309ffadc4c87a8061a318bd52d84 2023-02-18 03:01:01,633 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,633 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=029f725352138d7ea9db45e81a022538-8734215aa5704cc1b071455e2d44bfc0 2023-02-18 03:01:01,634 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------1ec6698ba75923360984a0df00eb89d5/ 2023-02-18 03:01:01,634 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,634 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,635 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=1ec6698ba75923360984a0df00eb89d5-1dc69d2f471846519261b6c797e73dca 2023-02-18 03:01:01,635 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,635 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=1ec6698ba75923360984a0df00eb89d5-81b764b8be974c30a0beac803607ebd2 2023-02-18 03:01:01,635 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------257de9664e172182d8b7399c286e5260/ 2023-02-18 03:01:01,636 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,636 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------8c3c65313de4bba554173bf1f16139a0/ 2023-02-18 03:01:01,636 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,637 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,637 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=8c3c65313de4bba554173bf1f16139a0-7874eaddcc314fa0905d166a6e849276 2023-02-18 03:01:01,637 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,637 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=8c3c65313de4bba554173bf1f16139a0-d2a7dd94c9454b6da6a8e00506f1aea5 2023-02-18 03:01:01,637 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------92fc0b60871303ea4c879666c381dfa3/ 2023-02-18 03:01:01,638 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,638 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,638 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=92fc0b60871303ea4c879666c381dfa3-bfbca279176d40b4b6ea1240e3e7cc61 2023-02-18 03:01:01,638 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,639 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=92fc0b60871303ea4c879666c381dfa3-8faad0a59a5e46daaa2f9d75aa6352bf 2023-02-18 03:01:01,639 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------a577f6de7f99d7d58994905f9315064e/ 2023-02-18 03:01:01,639 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,639 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,640 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=a577f6de7f99d7d58994905f9315064e-5f7c75c1db2141aeb25f9e57fa76a271 2023-02-18 03:01:01,640 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,640 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=a577f6de7f99d7d58994905f9315064e-68fee5176f3f4ec7903eb1fc9bb3c76b 2023-02-18 03:01:01,640 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------cf92b39f548d7531057934283dbb00c9/ 2023-02-18 03:01:01,641 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,641 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,642 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=cf92b39f548d7531057934283dbb00c9-b715697c192f4c46945c06590d31efb0 2023-02-18 03:01:01,642 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,642 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=cf92b39f548d7531057934283dbb00c9-3164bcb4705c4aed9f23771ade8827c2 2023-02-18 03:01:01,643 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------e00d71f6a1ee32bb35f1cdd56c0ffd56/ 2023-02-18 03:01:01,643 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,643 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------e422517004c3dbb0cb18915d918e7406/ 2023-02-18 03:01:01,644 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,644 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,645 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=e422517004c3dbb0cb18915d918e7406-4af0726d3bce4c46a4439481635ae655 2023-02-18 03:01:01,645 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,645 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=e422517004c3dbb0cb18915d918e7406-dd4968269c764edcaf88d83b558c82da 2023-02-18 03:01:01,645 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |----------eba8e412537abad8385f60594df5ea41/ 2023-02-18 03:01:01,646 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:01,646 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:01,647 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=eba8e412537abad8385f60594df5ea41-a63f97b509234236b8ebc2f100b7b31f 2023-02-18 03:01:01,647 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:01,647 DEBUG [Listener at localhost.localdomain/40571] util.CommonFSUtils(702): |----------------testWithMapReduce=eba8e412537abad8385f60594df5ea41-59595524e0904bb5a20b35d9b1d7dc6a 2023-02-18 03:01:01,655 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,655 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,655 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,656 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,656 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,657 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,657 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,720 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop-4114729055755154659.jar 2023-02-18 03:01:01,721 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,721 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,722 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,722 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,722 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,723 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,723 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 03:01:01,724 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 03:01:01,724 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 03:01:01,724 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 03:01:01,725 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 03:01:01,725 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 03:01:01,726 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 03:01:01,726 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 03:01:01,727 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 03:01:01,727 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 03:01:01,731 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:01,732 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:01,732 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:01,733 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:01,733 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 03:01:01,814 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop-9066890542863733518.jar 2023-02-18 03:01:01,814 DEBUG [Listener at localhost.localdomain/40571] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 03:01:01,863 WARN [Listener at localhost.localdomain/40571] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 03:01:01,917 INFO [Listener at localhost.localdomain/40571] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 03:01:02,201 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:02,202 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-18 03:01:02,289 WARN [Listener at localhost.localdomain/40571] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/mapreduce.cluster.local.dir/1676689262187/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 03:01:02,289 WARN [Listener at localhost.localdomain/40571] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/mapreduce.cluster.local.dir/1676689262187/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 03:01:02,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:02,466 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:02,469 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:02,472 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 029f725352138d7ea9db45e81a022538 2023-02-18 03:01:02,473 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1 2023-02-18 03:01:02,474 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 029f725352138d7ea9db45e81a022538 columnFamilyName f1 2023-02-18 03:01:02,486 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/testWithMapReduce=029f725352138d7ea9db45e81a022538-fb33309ffadc4c87a8061a318bd52d84 2023-02-18 03:01:02,487 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(310): Store=029f725352138d7ea9db45e81a022538/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,487 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 029f725352138d7ea9db45e81a022538 2023-02-18 03:01:02,488 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2 2023-02-18 03:01:02,489 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 029f725352138d7ea9db45e81a022538 columnFamilyName f2 2023-02-18 03:01:02,495 DEBUG [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/testWithMapReduce=029f725352138d7ea9db45e81a022538-8734215aa5704cc1b071455e2d44bfc0 2023-02-18 03:01:02,495 INFO [StoreOpener-029f725352138d7ea9db45e81a022538-1] regionserver.HStore(310): Store=029f725352138d7ea9db45e81a022538/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,495 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:02,495 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 029f725352138d7ea9db45e81a022538; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66838732, jitterRate=-0.004025280475616455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:02,495 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:01:02,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 029f725352138d7ea9db45e81a022538, disabling compactions & flushes 2023-02-18 03:01:02,665 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:02,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:02,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. after waiting 0 ms 2023-02-18 03:01:02,665 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:02,669 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:02,669 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:01:02,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:02,686 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:02,689 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:02,693 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:02,695 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1 2023-02-18 03:01:02,695 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec6698ba75923360984a0df00eb89d5 columnFamilyName f1 2023-02-18 03:01:02,705 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/testWithMapReduce=1ec6698ba75923360984a0df00eb89d5-1dc69d2f471846519261b6c797e73dca 2023-02-18 03:01:02,706 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(310): Store=1ec6698ba75923360984a0df00eb89d5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,706 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:02,707 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2 2023-02-18 03:01:02,707 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ec6698ba75923360984a0df00eb89d5 columnFamilyName f2 2023-02-18 03:01:02,715 DEBUG [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/testWithMapReduce=1ec6698ba75923360984a0df00eb89d5-81b764b8be974c30a0beac803607ebd2 2023-02-18 03:01:02,716 INFO [StoreOpener-1ec6698ba75923360984a0df00eb89d5-1] regionserver.HStore(310): Store=1ec6698ba75923360984a0df00eb89d5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,716 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:02,717 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1ec6698ba75923360984a0df00eb89d5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72842727, jitterRate=0.0854412168264389}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:02,717 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:01:02,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1ec6698ba75923360984a0df00eb89d5, disabling compactions & flushes 2023-02-18 03:01:02,772 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:02,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:02,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. after waiting 0 ms 2023-02-18 03:01:02,773 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:02,777 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:02,777 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:01:02,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:02,785 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:02,796 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:02,799 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:02,801 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1 2023-02-18 03:01:02,802 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf92b39f548d7531057934283dbb00c9 columnFamilyName f1 2023-02-18 03:01:02,817 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/testWithMapReduce=cf92b39f548d7531057934283dbb00c9-b715697c192f4c46945c06590d31efb0 2023-02-18 03:01:02,818 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(310): Store=cf92b39f548d7531057934283dbb00c9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,819 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:02,821 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2 2023-02-18 03:01:02,830 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf92b39f548d7531057934283dbb00c9 columnFamilyName f2 2023-02-18 03:01:02,861 DEBUG [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/testWithMapReduce=cf92b39f548d7531057934283dbb00c9-3164bcb4705c4aed9f23771ade8827c2 2023-02-18 03:01:02,861 INFO [StoreOpener-cf92b39f548d7531057934283dbb00c9-1] regionserver.HStore(310): Store=cf92b39f548d7531057934283dbb00c9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:02,862 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cf92b39f548d7531057934283dbb00c9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70070501, jitterRate=0.04413183033466339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:02,862 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:01:02,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cf92b39f548d7531057934283dbb00c9, disabling compactions & flushes 2023-02-18 03:01:02,910 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:02,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:02,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. after waiting 0 ms 2023-02-18 03:01:02,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:02,915 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:02,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:01:02,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:02,924 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:02,926 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:02,931 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:02,933 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1 2023-02-18 03:01:02,934 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92fc0b60871303ea4c879666c381dfa3 columnFamilyName f1 2023-02-18 03:01:02,953 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/testWithMapReduce=92fc0b60871303ea4c879666c381dfa3-bfbca279176d40b4b6ea1240e3e7cc61 2023-02-18 03:01:02,953 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(310): Store=92fc0b60871303ea4c879666c381dfa3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,953 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:02,955 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2 2023-02-18 03:01:02,956 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92fc0b60871303ea4c879666c381dfa3 columnFamilyName f2 2023-02-18 03:01:02,964 DEBUG [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/testWithMapReduce=92fc0b60871303ea4c879666c381dfa3-8faad0a59a5e46daaa2f9d75aa6352bf 2023-02-18 03:01:02,964 INFO [StoreOpener-92fc0b60871303ea4c879666c381dfa3-1] regionserver.HStore(310): Store=92fc0b60871303ea4c879666c381dfa3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:02,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:02,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 92fc0b60871303ea4c879666c381dfa3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65664556, jitterRate=-0.02152186632156372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:02,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:01:03,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 92fc0b60871303ea4c879666c381dfa3, disabling compactions & flushes 2023-02-18 03:01:03,016 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:03,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:03,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. after waiting 0 ms 2023-02-18 03:01:03,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:03,019 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:03,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:01:03,024 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:03,025 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:03,026 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:03,028 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:03,030 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1 2023-02-18 03:01:03,030 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c3c65313de4bba554173bf1f16139a0 columnFamilyName f1 2023-02-18 03:01:03,036 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/testWithMapReduce=8c3c65313de4bba554173bf1f16139a0-7874eaddcc314fa0905d166a6e849276 2023-02-18 03:01:03,037 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(310): Store=8c3c65313de4bba554173bf1f16139a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,037 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:03,038 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2 2023-02-18 03:01:03,038 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c3c65313de4bba554173bf1f16139a0 columnFamilyName f2 2023-02-18 03:01:03,044 DEBUG [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/testWithMapReduce=8c3c65313de4bba554173bf1f16139a0-d2a7dd94c9454b6da6a8e00506f1aea5 2023-02-18 03:01:03,044 INFO [StoreOpener-8c3c65313de4bba554173bf1f16139a0-1] regionserver.HStore(310): Store=8c3c65313de4bba554173bf1f16139a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,044 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:03,044 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8c3c65313de4bba554173bf1f16139a0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66945014, jitterRate=-0.0024415552616119385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:03,044 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:01:03,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8c3c65313de4bba554173bf1f16139a0, disabling compactions & flushes 2023-02-18 03:01:03,097 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:03,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:03,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. after waiting 0 ms 2023-02-18 03:01:03,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:03,101 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:03,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:01:03,108 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:03,108 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:03,111 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:03,115 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:03,117 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1 2023-02-18 03:01:03,117 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eba8e412537abad8385f60594df5ea41 columnFamilyName f1 2023-02-18 03:01:03,127 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/testWithMapReduce=eba8e412537abad8385f60594df5ea41-a63f97b509234236b8ebc2f100b7b31f 2023-02-18 03:01:03,127 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(310): Store=eba8e412537abad8385f60594df5ea41/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,127 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:03,129 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2 2023-02-18 03:01:03,129 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eba8e412537abad8385f60594df5ea41 columnFamilyName f2 2023-02-18 03:01:03,140 DEBUG [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/testWithMapReduce=eba8e412537abad8385f60594df5ea41-59595524e0904bb5a20b35d9b1d7dc6a 2023-02-18 03:01:03,141 INFO [StoreOpener-eba8e412537abad8385f60594df5ea41-1] regionserver.HStore(310): Store=eba8e412537abad8385f60594df5ea41/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:03,141 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened eba8e412537abad8385f60594df5ea41; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71640951, jitterRate=0.06753335893154144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:03,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:01:03,164 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing eba8e412537abad8385f60594df5ea41, disabling compactions & flushes 2023-02-18 03:01:03,165 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:03,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:03,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. after waiting 0 ms 2023-02-18 03:01:03,165 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:03,169 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:03,169 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:01:03,176 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:03,176 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:03,180 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:03,183 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:03,185 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1 2023-02-18 03:01:03,185 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e422517004c3dbb0cb18915d918e7406 columnFamilyName f1 2023-02-18 03:01:03,197 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/testWithMapReduce=e422517004c3dbb0cb18915d918e7406-4af0726d3bce4c46a4439481635ae655 2023-02-18 03:01:03,197 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(310): Store=e422517004c3dbb0cb18915d918e7406/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,197 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:03,198 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2 2023-02-18 03:01:03,199 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e422517004c3dbb0cb18915d918e7406 columnFamilyName f2 2023-02-18 03:01:03,204 DEBUG [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/testWithMapReduce=e422517004c3dbb0cb18915d918e7406-dd4968269c764edcaf88d83b558c82da 2023-02-18 03:01:03,205 INFO [StoreOpener-e422517004c3dbb0cb18915d918e7406-1] regionserver.HStore(310): Store=e422517004c3dbb0cb18915d918e7406/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,205 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:03,205 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e422517004c3dbb0cb18915d918e7406; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66988970, jitterRate=-0.001786559820175171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:03,205 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:01:03,228 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e422517004c3dbb0cb18915d918e7406, disabling compactions & flushes 2023-02-18 03:01:03,228 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:03,228 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:03,228 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. after waiting 0 ms 2023-02-18 03:01:03,228 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:03,231 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:03,232 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:01:03,239 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:03,239 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:03,240 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:03,242 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:03,243 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1 2023-02-18 03:01:03,244 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a577f6de7f99d7d58994905f9315064e columnFamilyName f1 2023-02-18 03:01:03,249 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/testWithMapReduce=a577f6de7f99d7d58994905f9315064e-5f7c75c1db2141aeb25f9e57fa76a271 2023-02-18 03:01:03,249 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(310): Store=a577f6de7f99d7d58994905f9315064e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,249 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:03,254 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2 2023-02-18 03:01:03,255 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a577f6de7f99d7d58994905f9315064e columnFamilyName f2 2023-02-18 03:01:03,260 DEBUG [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/testWithMapReduce=a577f6de7f99d7d58994905f9315064e-68fee5176f3f4ec7903eb1fc9bb3c76b 2023-02-18 03:01:03,261 INFO [StoreOpener-a577f6de7f99d7d58994905f9315064e-1] regionserver.HStore(310): Store=a577f6de7f99d7d58994905f9315064e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:03,261 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a577f6de7f99d7d58994905f9315064e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74155894, jitterRate=0.10500892996788025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:03,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:01:03,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a577f6de7f99d7d58994905f9315064e, disabling compactions & flushes 2023-02-18 03:01:03,287 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:03,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:03,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. after waiting 0 ms 2023-02-18 03:01:03,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:03,290 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:03,290 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:01:03,295 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:03,295 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:03,296 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:03,298 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 257de9664e172182d8b7399c286e5260 2023-02-18 03:01:03,300 DEBUG [StoreOpener-257de9664e172182d8b7399c286e5260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f1 2023-02-18 03:01:03,301 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 257de9664e172182d8b7399c286e5260 columnFamilyName f1 2023-02-18 03:01:03,302 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(310): Store=257de9664e172182d8b7399c286e5260/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,302 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 257de9664e172182d8b7399c286e5260 2023-02-18 03:01:03,303 DEBUG [StoreOpener-257de9664e172182d8b7399c286e5260-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f2 2023-02-18 03:01:03,304 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 257de9664e172182d8b7399c286e5260 columnFamilyName f2 2023-02-18 03:01:03,304 INFO [StoreOpener-257de9664e172182d8b7399c286e5260-1] regionserver.HStore(310): Store=257de9664e172182d8b7399c286e5260/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,304 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:03,305 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 257de9664e172182d8b7399c286e5260; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64993826, jitterRate=-0.03151652216911316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:03,305 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:01:03,314 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 257de9664e172182d8b7399c286e5260, disabling compactions & flushes 2023-02-18 03:01:03,314 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:03,314 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:03,314 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. after waiting 0 ms 2023-02-18 03:01:03,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:03,315 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:03,315 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:01:03,319 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:03,319 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:03,323 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:03,325 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:03,327 DEBUG [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f1 2023-02-18 03:01:03,327 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00d71f6a1ee32bb35f1cdd56c0ffd56 columnFamilyName f1 2023-02-18 03:01:03,328 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(310): Store=e00d71f6a1ee32bb35f1cdd56c0ffd56/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,328 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:03,331 DEBUG [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44311/user/jenkins/test-data/202a6c07-ab52-40a7-d6b4-9858c5ae84b0/testWithMapReduceMultiRegion/0cb018f8-3872-4955-a483-264d70cbd89a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f2 2023-02-18 03:01:03,331 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e00d71f6a1ee32bb35f1cdd56c0ffd56 columnFamilyName f2 2023-02-18 03:01:03,332 INFO [StoreOpener-e00d71f6a1ee32bb35f1cdd56c0ffd56-1] regionserver.HStore(310): Store=e00d71f6a1ee32bb35f1cdd56c0ffd56/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:03,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:03,332 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e00d71f6a1ee32bb35f1cdd56c0ffd56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60228418, jitterRate=-0.10252663493156433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:03,332 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:01:03,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e00d71f6a1ee32bb35f1cdd56c0ffd56, disabling compactions & flushes 2023-02-18 03:01:03,353 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:03,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:03,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. after waiting 0 ms 2023-02-18 03:01:03,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:03,354 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:03,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:01:04,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceMultiRegion" 2023-02-18 03:01:04,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-18 03:01:04,395 INFO [Listener at localhost.localdomain/40571] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 03:01:04,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-18 03:01:04,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-18 03:01:04,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689264409"}]},"ts":"1676689264409"} 2023-02-18 03:01:04,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:04,412 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-18 03:01:04,414 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-18 03:01:04,418 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, UNASSIGN}] 2023-02-18 03:01:04,429 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, UNASSIGN 2023-02-18 03:01:04,430 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, UNASSIGN 2023-02-18 03:01:04,430 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, UNASSIGN 2023-02-18 03:01:04,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, UNASSIGN 2023-02-18 03:01:04,430 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, UNASSIGN 2023-02-18 03:01:04,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cf92b39f548d7531057934283dbb00c9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:04,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264431"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264431"}]},"ts":"1676689264431"} 2023-02-18 03:01:04,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e422517004c3dbb0cb18915d918e7406, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:04,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264432"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264432"}]},"ts":"1676689264432"} 2023-02-18 03:01:04,433 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e00d71f6a1ee32bb35f1cdd56c0ffd56, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:04,433 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=257de9664e172182d8b7399c286e5260, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:04,433 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689264433"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264433"}]},"ts":"1676689264433"} 2023-02-18 03:01:04,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689264433"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264433"}]},"ts":"1676689264433"} 2023-02-18 03:01:04,433 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a577f6de7f99d7d58994905f9315064e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:04,433 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264433"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264433"}]},"ts":"1676689264433"} 2023-02-18 03:01:04,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=37, state=RUNNABLE; CloseRegionProcedure cf92b39f548d7531057934283dbb00c9, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:01:04,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure e422517004c3dbb0cb18915d918e7406, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:01:04,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=34, state=RUNNABLE; CloseRegionProcedure e00d71f6a1ee32bb35f1cdd56c0ffd56, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:01:04,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 257de9664e172182d8b7399c286e5260, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:01:04,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=36, state=RUNNABLE; CloseRegionProcedure a577f6de7f99d7d58994905f9315064e, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:01:04,467 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, UNASSIGN 2023-02-18 03:01:04,468 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, UNASSIGN 2023-02-18 03:01:04,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=92fc0b60871303ea4c879666c381dfa3, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:04,468 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, UNASSIGN 2023-02-18 03:01:04,468 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, UNASSIGN 2023-02-18 03:01:04,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264468"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264468"}]},"ts":"1676689264468"} 2023-02-18 03:01:04,468 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, UNASSIGN 2023-02-18 03:01:04,469 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8c3c65313de4bba554173bf1f16139a0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:04,469 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1ec6698ba75923360984a0df00eb89d5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:04,469 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264469"}]},"ts":"1676689264469"} 2023-02-18 03:01:04,469 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264469"}]},"ts":"1676689264469"} 2023-02-18 03:01:04,469 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=029f725352138d7ea9db45e81a022538, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:04,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=eba8e412537abad8385f60594df5ea41, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:04,470 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676689256264.029f725352138d7ea9db45e81a022538.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264469"}]},"ts":"1676689264469"} 2023-02-18 03:01:04,470 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676689256264.eba8e412537abad8385f60594df5ea41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264469"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689264469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689264469"}]},"ts":"1676689264469"} 2023-02-18 03:01:04,472 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 92fc0b60871303ea4c879666c381dfa3, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:01:04,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=40, state=RUNNABLE; CloseRegionProcedure 8c3c65313de4bba554173bf1f16139a0, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:01:04,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=41, state=RUNNABLE; CloseRegionProcedure 1ec6698ba75923360984a0df00eb89d5, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:01:04,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=38, state=RUNNABLE; CloseRegionProcedure 029f725352138d7ea9db45e81a022538, server=jenkins-hbase20.apache.org,46341,1676689253059}] 2023-02-18 03:01:04,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=39, state=RUNNABLE; CloseRegionProcedure eba8e412537abad8385f60594df5ea41, server=jenkins-hbase20.apache.org,41935,1676689253107}] 2023-02-18 03:01:04,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:04,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:04,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 92fc0b60871303ea4c879666c381dfa3, disabling compactions & flushes 2023-02-18 03:01:04,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:04,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:04,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. after waiting 0 ms 2023-02-18 03:01:04,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:04,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 257de9664e172182d8b7399c286e5260 2023-02-18 03:01:04,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 257de9664e172182d8b7399c286e5260, disabling compactions & flushes 2023-02-18 03:01:04,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:04,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:04,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. after waiting 0 ms 2023-02-18 03:01:04,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:04,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,626 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 03:01:04,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3. 2023-02-18 03:01:04,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 92fc0b60871303ea4c879666c381dfa3: 2023-02-18 03:01:04,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260. 2023-02-18 03:01:04,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 257de9664e172182d8b7399c286e5260: 2023-02-18 03:01:04,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:04,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:04,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8c3c65313de4bba554173bf1f16139a0, disabling compactions & flushes 2023-02-18 03:01:04,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:04,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:04,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. after waiting 0 ms 2023-02-18 03:01:04,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:04,630 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=92fc0b60871303ea4c879666c381dfa3, regionState=CLOSED 2023-02-18 03:01:04,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264630"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264630"}]},"ts":"1676689264630"} 2023-02-18 03:01:04,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 257de9664e172182d8b7399c286e5260 2023-02-18 03:01:04,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing cf92b39f548d7531057934283dbb00c9, disabling compactions & flushes 2023-02-18 03:01:04,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. after waiting 0 ms 2023-02-18 03:01:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:04,632 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=257de9664e172182d8b7399c286e5260, regionState=CLOSED 2023-02-18 03:01:04,632 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689264632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264632"}]},"ts":"1676689264632"} 2023-02-18 03:01:04,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-18 03:01:04,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 92fc0b60871303ea4c879666c381dfa3, server=jenkins-hbase20.apache.org,46341,1676689253059 in 161 msec 2023-02-18 03:01:04,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-18 03:01:04,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 257de9664e172182d8b7399c286e5260, server=jenkins-hbase20.apache.org,41935,1676689253107 in 194 msec 2023-02-18 03:01:04,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=92fc0b60871303ea4c879666c381dfa3, UNASSIGN in 217 msec 2023-02-18 03:01:04,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=257de9664e172182d8b7399c286e5260, UNASSIGN in 218 msec 2023-02-18 03:01:04,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0. 2023-02-18 03:01:04,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9. 2023-02-18 03:01:04,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8c3c65313de4bba554173bf1f16139a0: 2023-02-18 03:01:04,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for cf92b39f548d7531057934283dbb00c9: 2023-02-18 03:01:04,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:04,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing a577f6de7f99d7d58994905f9315064e, disabling compactions & flushes 2023-02-18 03:01:04,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. after waiting 0 ms 2023-02-18 03:01:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:04,657 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cf92b39f548d7531057934283dbb00c9, regionState=CLOSED 2023-02-18 03:01:04,658 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264657"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264657"}]},"ts":"1676689264657"} 2023-02-18 03:01:04,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:04,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 029f725352138d7ea9db45e81a022538 2023-02-18 03:01:04,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 029f725352138d7ea9db45e81a022538, disabling compactions & flushes 2023-02-18 03:01:04,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:04,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:04,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. after waiting 0 ms 2023-02-18 03:01:04,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:04,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8c3c65313de4bba554173bf1f16139a0, regionState=CLOSED 2023-02-18 03:01:04,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264660"}]},"ts":"1676689264660"} 2023-02-18 03:01:04,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=37 2023-02-18 03:01:04,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=37, state=SUCCESS; CloseRegionProcedure cf92b39f548d7531057934283dbb00c9, server=jenkins-hbase20.apache.org,41935,1676689253107 in 225 msec 2023-02-18 03:01:04,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=40 2023-02-18 03:01:04,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=40, state=SUCCESS; CloseRegionProcedure 8c3c65313de4bba554173bf1f16139a0, server=jenkins-hbase20.apache.org,46341,1676689253059 in 190 msec 2023-02-18 03:01:04,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf92b39f548d7531057934283dbb00c9, UNASSIGN in 248 msec 2023-02-18 03:01:04,666 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8c3c65313de4bba554173bf1f16139a0, UNASSIGN in 249 msec 2023-02-18 03:01:04,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538. 2023-02-18 03:01:04,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 029f725352138d7ea9db45e81a022538: 2023-02-18 03:01:04,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,691 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=029f725352138d7ea9db45e81a022538, regionState=CLOSED 2023-02-18 03:01:04,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e. 2023-02-18 03:01:04,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for a577f6de7f99d7d58994905f9315064e: 2023-02-18 03:01:04,692 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676689256264.029f725352138d7ea9db45e81a022538.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264691"}]},"ts":"1676689264691"} 2023-02-18 03:01:04,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 029f725352138d7ea9db45e81a022538 2023-02-18 03:01:04,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:04,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e422517004c3dbb0cb18915d918e7406, disabling compactions & flushes 2023-02-18 03:01:04,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:04,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:04,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. after waiting 0 ms 2023-02-18 03:01:04,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:04,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:04,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:04,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing eba8e412537abad8385f60594df5ea41, disabling compactions & flushes 2023-02-18 03:01:04,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:04,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:04,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. after waiting 0 ms 2023-02-18 03:01:04,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:04,695 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a577f6de7f99d7d58994905f9315064e, regionState=CLOSED 2023-02-18 03:01:04,696 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264695"}]},"ts":"1676689264695"} 2023-02-18 03:01:04,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=38 2023-02-18 03:01:04,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=38, state=SUCCESS; CloseRegionProcedure 029f725352138d7ea9db45e81a022538, server=jenkins-hbase20.apache.org,46341,1676689253059 in 217 msec 2023-02-18 03:01:04,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=36 2023-02-18 03:01:04,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=029f725352138d7ea9db45e81a022538, UNASSIGN in 284 msec 2023-02-18 03:01:04,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=36, state=SUCCESS; CloseRegionProcedure a577f6de7f99d7d58994905f9315064e, server=jenkins-hbase20.apache.org,41935,1676689253107 in 254 msec 2023-02-18 03:01:04,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406. 2023-02-18 03:01:04,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e422517004c3dbb0cb18915d918e7406: 2023-02-18 03:01:04,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a577f6de7f99d7d58994905f9315064e, UNASSIGN in 288 msec 2023-02-18 03:01:04,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:04,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:04,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e00d71f6a1ee32bb35f1cdd56c0ffd56, disabling compactions & flushes 2023-02-18 03:01:04,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:04,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:04,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. after waiting 0 ms 2023-02-18 03:01:04,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:04,709 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e422517004c3dbb0cb18915d918e7406, regionState=CLOSED 2023-02-18 03:01:04,709 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264709"}]},"ts":"1676689264709"} 2023-02-18 03:01:04,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:04,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-18 03:01:04,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure e422517004c3dbb0cb18915d918e7406, server=jenkins-hbase20.apache.org,46341,1676689253059 in 277 msec 2023-02-18 03:01:04,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e422517004c3dbb0cb18915d918e7406, UNASSIGN in 302 msec 2023-02-18 03:01:04,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 03:01:04,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41. 2023-02-18 03:01:04,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56. 2023-02-18 03:01:04,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for eba8e412537abad8385f60594df5ea41: 2023-02-18 03:01:04,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e00d71f6a1ee32bb35f1cdd56c0ffd56: 2023-02-18 03:01:04,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:04,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:04,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1ec6698ba75923360984a0df00eb89d5, disabling compactions & flushes 2023-02-18 03:01:04,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:04,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:04,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. after waiting 0 ms 2023-02-18 03:01:04,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:04,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=eba8e412537abad8385f60594df5ea41, regionState=CLOSED 2023-02-18 03:01:04,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676689256264.eba8e412537abad8385f60594df5ea41.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264738"}]},"ts":"1676689264738"} 2023-02-18 03:01:04,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:04,741 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e00d71f6a1ee32bb35f1cdd56c0ffd56, regionState=CLOSED 2023-02-18 03:01:04,741 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689264741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264741"}]},"ts":"1676689264741"} 2023-02-18 03:01:04,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=39 2023-02-18 03:01:04,748 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=39, state=SUCCESS; CloseRegionProcedure eba8e412537abad8385f60594df5ea41, server=jenkins-hbase20.apache.org,41935,1676689253107 in 265 msec 2023-02-18 03:01:04,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=34 2023-02-18 03:01:04,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=34, state=SUCCESS; CloseRegionProcedure e00d71f6a1ee32bb35f1cdd56c0ffd56, server=jenkins-hbase20.apache.org,46341,1676689253059 in 305 msec 2023-02-18 03:01:04,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=eba8e412537abad8385f60594df5ea41, UNASSIGN in 332 msec 2023-02-18 03:01:04,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e00d71f6a1ee32bb35f1cdd56c0ffd56, UNASSIGN in 335 msec 2023-02-18 03:01:04,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:04,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5. 2023-02-18 03:01:04,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1ec6698ba75923360984a0df00eb89d5: 2023-02-18 03:01:04,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:04,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1ec6698ba75923360984a0df00eb89d5, regionState=CLOSED 2023-02-18 03:01:04,782 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689264781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689264781"}]},"ts":"1676689264781"} 2023-02-18 03:01:04,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=41 2023-02-18 03:01:04,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=41, state=SUCCESS; CloseRegionProcedure 1ec6698ba75923360984a0df00eb89d5, server=jenkins-hbase20.apache.org,41935,1676689253107 in 310 msec 2023-02-18 03:01:04,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=33 2023-02-18 03:01:04,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ec6698ba75923360984a0df00eb89d5, UNASSIGN in 372 msec 2023-02-18 03:01:04,795 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689264794"}]},"ts":"1676689264794"} 2023-02-18 03:01:04,797 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-18 03:01:04,799 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-18 03:01:04,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 404 msec 2023-02-18 03:01:05,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:05,015 INFO [Listener at localhost.localdomain/40571] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-18 03:01:05,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-18 03:01:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:05,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:05,035 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:05,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 03:01:05,056 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:05,056 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:05,056 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:05,056 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:05,056 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 2023-02-18 03:01:05,056 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:05,057 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:05,057 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:05,065 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/recovered.edits] 2023-02-18 03:01:05,065 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/recovered.edits] 2023-02-18 03:01:05,065 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/recovered.edits] 2023-02-18 03:01:05,065 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/recovered.edits] 2023-02-18 03:01:05,065 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/recovered.edits] 2023-02-18 03:01:05,067 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/recovered.edits] 2023-02-18 03:01:05,067 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/recovered.edits] 2023-02-18 03:01:05,073 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/recovered.edits] 2023-02-18 03:01:05,078 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/1dc69d2f471846519261b6c797e73dca to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/1dc69d2f471846519261b6c797e73dca 2023-02-18 03:01:05,079 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/57d019f4ca3443a3a6d4ae37f77be221 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/57d019f4ca3443a3a6d4ae37f77be221 2023-02-18 03:01:05,079 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4ab9257b07eb44cbbc5249130d83e4b1 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4ab9257b07eb44cbbc5249130d83e4b1 2023-02-18 03:01:05,079 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/5f7c75c1db2141aeb25f9e57fa76a271 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/5f7c75c1db2141aeb25f9e57fa76a271 2023-02-18 03:01:05,080 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/6f03e74973af45278883d213d06d1343 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/6f03e74973af45278883d213d06d1343 2023-02-18 03:01:05,081 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/1fb935bc3a3f4b8180a229aaeef73e84 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/1fb935bc3a3f4b8180a229aaeef73e84 2023-02-18 03:01:05,082 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4af0726d3bce4c46a4439481635ae655 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f1/4af0726d3bce4c46a4439481635ae655 2023-02-18 03:01:05,083 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/81379d4a1f33448fa485bc97f91d61d9 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f1/81379d4a1f33448fa485bc97f91d61d9 2023-02-18 03:01:05,083 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/62f7df459df942bb81203a735965f161 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f1/62f7df459df942bb81203a735965f161 2023-02-18 03:01:05,084 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/a63f97b509234236b8ebc2f100b7b31f to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f1/a63f97b509234236b8ebc2f100b7b31f 2023-02-18 03:01:05,084 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/b715697c192f4c46945c06590d31efb0 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f1/b715697c192f4c46945c06590d31efb0 2023-02-18 03:01:05,084 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/fb33309ffadc4c87a8061a318bd52d84 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f1/fb33309ffadc4c87a8061a318bd52d84 2023-02-18 03:01:05,085 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/recovered.edits/6.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56/recovered.edits/6.seqid 2023-02-18 03:01:05,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e00d71f6a1ee32bb35f1cdd56c0ffd56 2023-02-18 03:01:05,088 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:05,089 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/7874eaddcc314fa0905d166a6e849276 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/7874eaddcc314fa0905d166a6e849276 2023-02-18 03:01:05,094 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/d544f6f24a0f44f4ab9179a05cc5d7c7 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f1/d544f6f24a0f44f4ab9179a05cc5d7c7 2023-02-18 03:01:05,095 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/recovered.edits] 2023-02-18 03:01:05,096 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/68fee5176f3f4ec7903eb1fc9bb3c76b to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/68fee5176f3f4ec7903eb1fc9bb3c76b 2023-02-18 03:01:05,096 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/24afd32ed4024600830b65a33af0c46c to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/24afd32ed4024600830b65a33af0c46c 2023-02-18 03:01:05,097 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/3164bcb4705c4aed9f23771ade8827c2 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/3164bcb4705c4aed9f23771ade8827c2 2023-02-18 03:01:05,097 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/457dcedcbf6d459c8a8da239b21023c3 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/457dcedcbf6d459c8a8da239b21023c3 2023-02-18 03:01:05,097 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/51c790d3bc0c4163b908e9b3b8eb2bce to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/51c790d3bc0c4163b908e9b3b8eb2bce 2023-02-18 03:01:05,106 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/e56a0855699a4367aabe91bf51c81b5d to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/f2/e56a0855699a4367aabe91bf51c81b5d 2023-02-18 03:01:05,106 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/dd4968269c764edcaf88d83b558c82da to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/f2/dd4968269c764edcaf88d83b558c82da 2023-02-18 03:01:05,109 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/4c4c535cdfad426f8c71c570974093ad to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/4c4c535cdfad426f8c71c570974093ad 2023-02-18 03:01:05,110 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/ef12ed07d610454bb7afefca3f386fff to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/f2/ef12ed07d610454bb7afefca3f386fff 2023-02-18 03:01:05,110 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/81b764b8be974c30a0beac803607ebd2 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/f2/81b764b8be974c30a0beac803607ebd2 2023-02-18 03:01:05,112 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/59595524e0904bb5a20b35d9b1d7dc6a to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/f2/59595524e0904bb5a20b35d9b1d7dc6a 2023-02-18 03:01:05,112 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/9a35547df5af4637989f0f9f2ac2b661 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/9a35547df5af4637989f0f9f2ac2b661 2023-02-18 03:01:05,114 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/8734215aa5704cc1b071455e2d44bfc0 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/f2/8734215aa5704cc1b071455e2d44bfc0 2023-02-18 03:01:05,117 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/d2a7dd94c9454b6da6a8e00506f1aea5 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/f2/d2a7dd94c9454b6da6a8e00506f1aea5 2023-02-18 03:01:05,119 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/14cc1f5aa6c944f4a1aac122a9b06d1f to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/14cc1f5aa6c944f4a1aac122a9b06d1f 2023-02-18 03:01:05,123 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406/recovered.edits/12.seqid 2023-02-18 03:01:05,123 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e/recovered.edits/12.seqid 2023-02-18 03:01:05,124 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/e422517004c3dbb0cb18915d918e7406 2023-02-18 03:01:05,124 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 2023-02-18 03:01:05,125 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/a577f6de7f99d7d58994905f9315064e 2023-02-18 03:01:05,125 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41/recovered.edits/12.seqid 2023-02-18 03:01:05,126 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/bfbca279176d40b4b6ea1240e3e7cc61 to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f1/bfbca279176d40b4b6ea1240e3e7cc61 2023-02-18 03:01:05,126 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9/recovered.edits/12.seqid 2023-02-18 03:01:05,126 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5/recovered.edits/12.seqid 2023-02-18 03:01:05,126 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/eba8e412537abad8385f60594df5ea41 2023-02-18 03:01:05,127 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0/recovered.edits/12.seqid 2023-02-18 03:01:05,128 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/cf92b39f548d7531057934283dbb00c9 2023-02-18 03:01:05,128 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/1ec6698ba75923360984a0df00eb89d5 2023-02-18 03:01:05,128 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/8c3c65313de4bba554173bf1f16139a0 2023-02-18 03:01:05,128 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538/recovered.edits/12.seqid 2023-02-18 03:01:05,129 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/029f725352138d7ea9db45e81a022538 2023-02-18 03:01:05,129 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f1, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/f2, FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/recovered.edits] 2023-02-18 03:01:05,131 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/876ee038f3024e75a20c473707a3326f to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/876ee038f3024e75a20c473707a3326f 2023-02-18 03:01:05,133 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/8faad0a59a5e46daaa2f9d75aa6352bf to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/f2/8faad0a59a5e46daaa2f9d75aa6352bf 2023-02-18 03:01:05,135 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/recovered.edits/6.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260/recovered.edits/6.seqid 2023-02-18 03:01:05,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 03:01:05,139 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/257de9664e172182d8b7399c286e5260 2023-02-18 03:01:05,139 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/recovered.edits/12.seqid to hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/archive/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3/recovered.edits/12.seqid 2023-02-18 03:01:05,144 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/.tmp/data/default/testWithMapReduce/92fc0b60871303ea4c879666c381dfa3 2023-02-18 03:01:05,144 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 03:01:05,147 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:05,172 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-18 03:01:05,177 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-18 03:01:05,179 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:05,179 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-18 03:01:05,179 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676689256264.029f725352138d7ea9db45e81a022538.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676689256264.eba8e412537abad8385f60594df5ea41.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689265179"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,188 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-18 03:01:05,188 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e00d71f6a1ee32bb35f1cdd56c0ffd56, NAME => 'testWithMapReduce,,1676689256264.e00d71f6a1ee32bb35f1cdd56c0ffd56.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e422517004c3dbb0cb18915d918e7406, NAME => 'testWithMapReduce,aaa,1676689256264.e422517004c3dbb0cb18915d918e7406.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => a577f6de7f99d7d58994905f9315064e, NAME => 'testWithMapReduce,d\x84\x84,1676689256264.a577f6de7f99d7d58994905f9315064e.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => cf92b39f548d7531057934283dbb00c9, NAME => 'testWithMapReduce,g\xA7\xA7,1676689256264.cf92b39f548d7531057934283dbb00c9.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 029f725352138d7ea9db45e81a022538, NAME => 'testWithMapReduce,j\xCA\xCA,1676689256264.029f725352138d7ea9db45e81a022538.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => eba8e412537abad8385f60594df5ea41, NAME => 'testWithMapReduce,m\xED\xED,1676689256264.eba8e412537abad8385f60594df5ea41.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 8c3c65313de4bba554173bf1f16139a0, NAME => 'testWithMapReduce,q\x11\x10,1676689256264.8c3c65313de4bba554173bf1f16139a0.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 1ec6698ba75923360984a0df00eb89d5, NAME => 'testWithMapReduce,t43,1676689256264.1ec6698ba75923360984a0df00eb89d5.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 92fc0b60871303ea4c879666c381dfa3, NAME => 'testWithMapReduce,wWV,1676689256264.92fc0b60871303ea4c879666c381dfa3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 257de9664e172182d8b7399c286e5260, NAME => 'testWithMapReduce,zz{,1676689256264.257de9664e172182d8b7399c286e5260.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-18 03:01:05,188 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-18 03:01:05,188 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676689265188"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:05,191 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-18 03:01:05,193 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:05,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 172 msec 2023-02-18 03:01:05,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39021] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 03:01:05,340 INFO [Listener at localhost.localdomain/40571] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-18 03:01:05,340 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:05,340 INFO [Listener at localhost.localdomain/40571] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:05,340 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09970056 to 127.0.0.1:56438 2023-02-18 03:01:05,341 DEBUG [Listener at localhost.localdomain/40571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,341 DEBUG [Listener at localhost.localdomain/40571] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:05,341 DEBUG [Listener at localhost.localdomain/40571] util.JVMClusterUtil(257): Found active master hash=1497629117, stopped=false 2023-02-18 03:01:05,341 INFO [Listener at localhost.localdomain/40571] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:01:05,343 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:05,343 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:05,343 INFO [Listener at localhost.localdomain/40571] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:05,343 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:05,344 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:05,345 DEBUG [Listener at localhost.localdomain/40571] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37597f1e to 127.0.0.1:56438 2023-02-18 03:01:05,345 DEBUG [Listener at localhost.localdomain/40571] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:05,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:05,346 INFO [Listener at localhost.localdomain/40571] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,46341,1676689253059' ***** 2023-02-18 03:01:05,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:05,346 INFO [Listener at localhost.localdomain/40571] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:05,346 INFO [Listener at localhost.localdomain/40571] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41935,1676689253107' ***** 2023-02-18 03:01:05,346 INFO [Listener at localhost.localdomain/40571] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:05,346 INFO [RS:0;jenkins-hbase20:46341] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:05,347 INFO [RS:1;jenkins-hbase20:41935] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:05,347 INFO [RS:0;jenkins-hbase20:46341] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:05,347 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:05,347 INFO [RS:0;jenkins-hbase20:46341] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:05,347 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:05,347 INFO [RS:1;jenkins-hbase20:41935] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:05,348 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(3304): Received CLOSE for 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:01:05,348 INFO [RS:1;jenkins-hbase20:41935] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:05,348 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:05,349 DEBUG [RS:1;jenkins-hbase20:41935] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29f60d6b to 127.0.0.1:56438 2023-02-18 03:01:05,349 DEBUG [RS:1;jenkins-hbase20:41935] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,349 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:05,349 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41935,1676689253107; all regions closed. 2023-02-18 03:01:05,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 4a54f3fbdf4e594b394fc115482fc120, disabling compactions & flushes 2023-02-18 03:01:05,349 DEBUG [RS:0;jenkins-hbase20:46341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73fab016 to 127.0.0.1:56438 2023-02-18 03:01:05,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:01:05,350 DEBUG [RS:0;jenkins-hbase20:46341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:01:05,350 INFO [RS:0;jenkins-hbase20:46341] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:05,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. after waiting 0 ms 2023-02-18 03:01:05,350 INFO [RS:0;jenkins-hbase20:46341] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:05,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:01:05,350 INFO [RS:0;jenkins-hbase20:46341] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:05,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 4a54f3fbdf4e594b394fc115482fc120 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:05,350 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:05,354 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 03:01:05,354 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 4a54f3fbdf4e594b394fc115482fc120=hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120.} 2023-02-18 03:01:05,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:05,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:05,356 DEBUG [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1505): Waiting on 1588230740, 4a54f3fbdf4e594b394fc115482fc120 2023-02-18 03:01:05,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:05,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:05,358 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:05,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.32 KB heapSize=40.20 KB 2023-02-18 03:01:05,360 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/WALs/jenkins-hbase20.apache.org,41935,1676689253107/jenkins-hbase20.apache.org%2C41935%2C1676689253107.1676689255517 not finished, retry = 0 2023-02-18 03:01:05,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/.tmp/info/6922080df0c74ef0b98de849cff0703c 2023-02-18 03:01:05,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/.tmp/info/6922080df0c74ef0b98de849cff0703c as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/info/6922080df0c74ef0b98de849cff0703c 2023-02-18 03:01:05,377 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:05,378 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:05,380 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.11 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/.tmp/info/822b5ab714a54d099b86a13a9e5bda44 2023-02-18 03:01:05,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/info/6922080df0c74ef0b98de849cff0703c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:05,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4a54f3fbdf4e594b394fc115482fc120 in 36ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:05,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 822b5ab714a54d099b86a13a9e5bda44 2023-02-18 03:01:05,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/namespace/4a54f3fbdf4e594b394fc115482fc120/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:05,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:01:05,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 4a54f3fbdf4e594b394fc115482fc120: 2023-02-18 03:01:05,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689255021.4a54f3fbdf4e594b394fc115482fc120. 2023-02-18 03:01:05,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/.tmp/rep_barrier/44e526d3bfbe40e69861400505d4d9e9 2023-02-18 03:01:05,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44e526d3bfbe40e69861400505d4d9e9 2023-02-18 03:01:05,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/.tmp/table/878ee5d76a234925b022938528134267 2023-02-18 03:01:05,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 878ee5d76a234925b022938528134267 2023-02-18 03:01:05,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/.tmp/info/822b5ab714a54d099b86a13a9e5bda44 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/info/822b5ab714a54d099b86a13a9e5bda44 2023-02-18 03:01:05,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 822b5ab714a54d099b86a13a9e5bda44 2023-02-18 03:01:05,438 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/info/822b5ab714a54d099b86a13a9e5bda44, entries=30, sequenceid=57, filesize=7.9 K 2023-02-18 03:01:05,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/.tmp/rep_barrier/44e526d3bfbe40e69861400505d4d9e9 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/rep_barrier/44e526d3bfbe40e69861400505d4d9e9 2023-02-18 03:01:05,445 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 03:01:05,445 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 03:01:05,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44e526d3bfbe40e69861400505d4d9e9 2023-02-18 03:01:05,447 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/rep_barrier/44e526d3bfbe40e69861400505d4d9e9, entries=10, sequenceid=57, filesize=5.9 K 2023-02-18 03:01:05,448 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/.tmp/table/878ee5d76a234925b022938528134267 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/table/878ee5d76a234925b022938528134267 2023-02-18 03:01:05,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 878ee5d76a234925b022938528134267 2023-02-18 03:01:05,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/table/878ee5d76a234925b022938528134267, entries=13, sequenceid=57, filesize=5.9 K 2023-02-18 03:01:05,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.32 KB/24908, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 98ms, sequenceid=57, compaction requested=false 2023-02-18 03:01:05,464 DEBUG [RS:1;jenkins-hbase20:41935] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/oldWALs 2023-02-18 03:01:05,465 INFO [RS:1;jenkins-hbase20:41935] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41935%2C1676689253107:(num 1676689255517) 2023-02-18 03:01:05,465 DEBUG [RS:1;jenkins-hbase20:41935] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,465 INFO [RS:1;jenkins-hbase20:41935] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:05,465 INFO [RS:1;jenkins-hbase20:41935] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:05,465 INFO [RS:1;jenkins-hbase20:41935] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:05,465 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:05,465 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-18 03:01:05,465 INFO [RS:1;jenkins-hbase20:41935] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:05,465 INFO [RS:1;jenkins-hbase20:41935] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:05,466 INFO [RS:1;jenkins-hbase20:41935] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41935 2023-02-18 03:01:05,467 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:05,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:05,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:05,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:05,474 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:05,474 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:05,474 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41935,1676689253107 2023-02-18 03:01:05,474 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:05,474 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17bfc6e0 rejected from java.util.concurrent.ThreadPoolExecutor@138050cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:05,474 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:05,474 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@effb077 rejected from java.util.concurrent.ThreadPoolExecutor@138050cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:05,475 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41935,1676689253107] 2023-02-18 03:01:05,475 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41935,1676689253107; numProcessing=1 2023-02-18 03:01:05,475 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41935,1676689253107 already deleted, retry=false 2023-02-18 03:01:05,475 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41935,1676689253107 expired; onlineServers=1 2023-02-18 03:01:05,557 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,46341,1676689253059; all regions closed. 2023-02-18 03:01:05,562 DEBUG [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/oldWALs 2023-02-18 03:01:05,562 INFO [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46341%2C1676689253059.meta:.meta(num 1676689254773) 2023-02-18 03:01:05,567 DEBUG [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/oldWALs 2023-02-18 03:01:05,567 INFO [RS:0;jenkins-hbase20:46341] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46341%2C1676689253059:(num 1676689255518) 2023-02-18 03:01:05,567 DEBUG [RS:0;jenkins-hbase20:46341] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,567 INFO [RS:0;jenkins-hbase20:46341] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:05,567 INFO [RS:0;jenkins-hbase20:46341] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:05,568 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:05,568 INFO [RS:0;jenkins-hbase20:46341] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46341 2023-02-18 03:01:05,570 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46341,1676689253059 2023-02-18 03:01:05,570 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:05,571 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46341,1676689253059] 2023-02-18 03:01:05,571 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46341,1676689253059; numProcessing=2 2023-02-18 03:01:05,572 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46341,1676689253059 already deleted, retry=false 2023-02-18 03:01:05,572 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46341,1676689253059 expired; onlineServers=0 2023-02-18 03:01:05,572 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39021,1676689252067' ***** 2023-02-18 03:01:05,572 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:05,572 DEBUG [M:0;jenkins-hbase20:39021] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18790b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:05,572 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39021,1676689252067 2023-02-18 03:01:05,572 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39021,1676689252067; all regions closed. 2023-02-18 03:01:05,572 DEBUG [M:0;jenkins-hbase20:39021] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:05,572 DEBUG [M:0;jenkins-hbase20:39021] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:05,573 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:05,573 DEBUG [M:0;jenkins-hbase20:39021] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:05,573 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689254251] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689254251,5,FailOnTimeoutGroup] 2023-02-18 03:01:05,573 INFO [M:0;jenkins-hbase20:39021] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:05,573 INFO [M:0;jenkins-hbase20:39021] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:05,573 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689254251] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689254251,5,FailOnTimeoutGroup] 2023-02-18 03:01:05,574 INFO [M:0;jenkins-hbase20:39021] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:05,574 DEBUG [M:0;jenkins-hbase20:39021] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:05,574 INFO [M:0;jenkins-hbase20:39021] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:05,579 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:05,579 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:05,579 ERROR [M:0;jenkins-hbase20:39021] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-18 03:01:05,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:05,580 INFO [M:0;jenkins-hbase20:39021] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:05,580 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:05,580 DEBUG [M:0;jenkins-hbase20:39021] zookeeper.ZKUtil(398): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:05,580 WARN [M:0;jenkins-hbase20:39021] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:05,581 INFO [M:0;jenkins-hbase20:39021] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:05,581 INFO [M:0;jenkins-hbase20:39021] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:05,581 DEBUG [M:0;jenkins-hbase20:39021] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:05,582 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:05,582 DEBUG [M:0;jenkins-hbase20:39021] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:05,582 DEBUG [M:0;jenkins-hbase20:39021] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:05,582 DEBUG [M:0;jenkins-hbase20:39021] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:05,582 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.52 KB heapSize=192.48 KB 2023-02-18 03:01:05,613 INFO [M:0;jenkins-hbase20:39021] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.52 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a452a7f8e617492b90efd169e8352f47 2023-02-18 03:01:05,619 DEBUG [M:0;jenkins-hbase20:39021] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a452a7f8e617492b90efd169e8352f47 as hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a452a7f8e617492b90efd169e8352f47 2023-02-18 03:01:05,625 INFO [M:0;jenkins-hbase20:39021] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44311/user/jenkins/test-data/e531ed2e-4212-4366-9b68-3d86dde4727a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a452a7f8e617492b90efd169e8352f47, entries=53, sequenceid=357, filesize=10.4 K 2023-02-18 03:01:05,626 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegion(2947): Finished flush of dataSize ~159.52 KB/163348, heapSize ~192.47 KB/197088, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 44ms, sequenceid=357, compaction requested=false 2023-02-18 03:01:05,631 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:05,631 DEBUG [M:0;jenkins-hbase20:39021] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:05,635 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:05,635 INFO [M:0;jenkins-hbase20:39021] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:05,637 INFO [M:0;jenkins-hbase20:39021] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39021 2023-02-18 03:01:05,640 DEBUG [M:0;jenkins-hbase20:39021] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,39021,1676689252067 already deleted, retry=false 2023-02-18 03:01:05,845 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:05,845 INFO [M:0;jenkins-hbase20:39021] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39021,1676689252067; zookeeper connection closed. 2023-02-18 03:01:05,846 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7fcb9a2e rejected from java.util.concurrent.ThreadPoolExecutor@1b3a2b74[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:05,846 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): master:39021-0x10173875d660000, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:05,846 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@692c3e49 rejected from java.util.concurrent.ThreadPoolExecutor@1b3a2b74[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:05,946 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:05,946 INFO [RS:0;jenkins-hbase20:46341] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,46341,1676689253059; zookeeper connection closed. 2023-02-18 03:01:05,946 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40c37004 rejected from java.util.concurrent.ThreadPoolExecutor@44fcfcc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:05,946 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:46341-0x10173875d660001, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:05,946 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d85c35f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d85c35f 2023-02-18 03:01:05,946 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6badf483 rejected from java.util.concurrent.ThreadPoolExecutor@44fcfcc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:06,046 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:06,046 INFO [RS:1;jenkins-hbase20:41935] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41935,1676689253107; zookeeper connection closed. 2023-02-18 03:01:06,046 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7689dd8a rejected from java.util.concurrent.ThreadPoolExecutor@138050cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:06,046 DEBUG [Listener at localhost.localdomain/40571-EventThread] zookeeper.ZKWatcher(600): regionserver:41935-0x10173875d660002, quorum=127.0.0.1:56438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:06,046 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42147b8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42147b8 2023-02-18 03:01:06,046 ERROR [Listener at localhost.localdomain/40571-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4522413e rejected from java.util.concurrent.ThreadPoolExecutor@138050cf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:06,047 INFO [Listener at localhost.localdomain/40571] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:06,047 WARN [Listener at localhost.localdomain/40571] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:06,051 INFO [Listener at localhost.localdomain/40571] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:06,160 WARN [BP-680266581-148.251.75.209-1676689248871 heartbeating to localhost.localdomain/127.0.0.1:44311] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:06,160 WARN [BP-680266581-148.251.75.209-1676689248871 heartbeating to localhost.localdomain/127.0.0.1:44311] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-680266581-148.251.75.209-1676689248871 (Datanode Uuid 5bbff44f-8a58-40ec-af75-c576d346efca) service to localhost.localdomain/127.0.0.1:44311 2023-02-18 03:01:06,162 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/dfs/data/data3/current/BP-680266581-148.251.75.209-1676689248871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:06,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/dfs/data/data4/current/BP-680266581-148.251.75.209-1676689248871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:06,165 WARN [Listener at localhost.localdomain/40571] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:06,168 INFO [Listener at localhost.localdomain/40571] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:06,271 WARN [BP-680266581-148.251.75.209-1676689248871 heartbeating to localhost.localdomain/127.0.0.1:44311] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:06,271 WARN [BP-680266581-148.251.75.209-1676689248871 heartbeating to localhost.localdomain/127.0.0.1:44311] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-680266581-148.251.75.209-1676689248871 (Datanode Uuid 6ec9f9b1-f04a-4b7a-865b-c7edcfcd8dcc) service to localhost.localdomain/127.0.0.1:44311 2023-02-18 03:01:06,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/dfs/data/data1/current/BP-680266581-148.251.75.209-1676689248871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:06,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/cluster_75c53c49-e4e9-7a46-8bc7-4797c2b58900/dfs/data/data2/current/BP-680266581-148.251.75.209-1676689248871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:06,298 INFO [Listener at localhost.localdomain/40571] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:06,416 INFO [Listener at localhost.localdomain/40571] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:06,481 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:06,494 INFO [Listener at localhost.localdomain/40571] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=101 (was 7) Potentially hanging thread: (jenkins-hbase20.apache.org,39021,1676689252067)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost.localdomain:44311 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: Listener at localhost.localdomain/40571 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:44311 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase20:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:44311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:44311 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost.localdomain:44311 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@639f3000 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:44311 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:44311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:327) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) - Thread LEAK? -, OpenFileDescriptor=545 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 111) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 163) - ProcessCount LEAK? -, AvailableMemoryMB=3913 (was 5449) 2023-02-18 03:01:06,502 INFO [Listener at localhost.localdomain/40571] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=101, OpenFileDescriptor=545, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=165, AvailableMemoryMB=3913 2023-02-18 03:01:06,510 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop.log.dir so I do NOT create it in target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932 2023-02-18 03:01:06,511 WARN [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop.tmp.dir so I do NOT create it in target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932 2023-02-18 03:01:06,511 WARN [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/36548425-37ab-078a-02e6-ab9728948f4d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 03:01:06,511 DEBUG [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484, deleteOnExit=true 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/test.cache.data in system properties and HBase conf 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:01:06,511 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:01:06,512 DEBUG [Listener at localhost.localdomain/40571] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:01:06,512 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:01:06,513 INFO [Listener at localhost.localdomain/40571] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:01:06,516 WARN [Listener at localhost.localdomain/40571] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:06,516 WARN [Listener at localhost.localdomain/40571] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:06,545 WARN [Listener at localhost.localdomain/40571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:06,547 INFO [Listener at localhost.localdomain/40571] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:06,552 INFO [Listener at localhost.localdomain/40571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/java.io.tmpdir/Jetty_localhost_localdomain_38589_hdfs____.kdloz9/webapp 2023-02-18 03:01:06,638 INFO [Listener at localhost.localdomain/40571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38589 2023-02-18 03:01:06,641 WARN [Listener at localhost.localdomain/40571] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:06,641 WARN [Listener at localhost.localdomain/40571] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:06,671 WARN [Listener at localhost.localdomain/33221] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:06,688 WARN [Listener at localhost.localdomain/33221] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:06,690 WARN [Listener at localhost.localdomain/33221] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:06,691 INFO [Listener at localhost.localdomain/33221] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:06,696 INFO [Listener at localhost.localdomain/33221] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/java.io.tmpdir/Jetty_localhost_45235_datanode____.sk2cva/webapp 2023-02-18 03:01:06,767 INFO [Listener at localhost.localdomain/33221] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45235 2023-02-18 03:01:06,779 WARN [Listener at localhost.localdomain/33543] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:06,797 WARN [Listener at localhost.localdomain/33543] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:06,800 WARN [Listener at localhost.localdomain/33543] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:06,802 INFO [Listener at localhost.localdomain/33543] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:06,807 INFO [Listener at localhost.localdomain/33543] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/java.io.tmpdir/Jetty_localhost_38133_datanode____.kgqrf1/webapp 2023-02-18 03:01:06,880 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf38f5f20520678aa: Processing first storage report for DS-c5db666e-812a-475f-bed2-3daf9a546e2c from datanode f263734a-f319-4830-a42e-f54af7c42acd 2023-02-18 03:01:06,881 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf38f5f20520678aa: from storage DS-c5db666e-812a-475f-bed2-3daf9a546e2c node DatanodeRegistration(127.0.0.1:37223, datanodeUuid=f263734a-f319-4830-a42e-f54af7c42acd, infoPort=37127, infoSecurePort=0, ipcPort=33543, storageInfo=lv=-57;cid=testClusterID;nsid=2083037176;c=1676689266517), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:06,881 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf38f5f20520678aa: Processing first storage report for DS-8d534376-cb91-4451-b5ff-4741c82c9260 from datanode f263734a-f319-4830-a42e-f54af7c42acd 2023-02-18 03:01:06,881 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf38f5f20520678aa: from storage DS-8d534376-cb91-4451-b5ff-4741c82c9260 node DatanodeRegistration(127.0.0.1:37223, datanodeUuid=f263734a-f319-4830-a42e-f54af7c42acd, infoPort=37127, infoSecurePort=0, ipcPort=33543, storageInfo=lv=-57;cid=testClusterID;nsid=2083037176;c=1676689266517), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:06,923 INFO [Listener at localhost.localdomain/33543] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38133 2023-02-18 03:01:06,974 WARN [Listener at localhost.localdomain/46707] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:07,048 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x67e276bdfeacfcf3: Processing first storage report for DS-4af2f098-ebde-4a00-a62f-82a35c69fe02 from datanode f0b33787-61ce-4cbb-acb7-47cd28308fd3 2023-02-18 03:01:07,048 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x67e276bdfeacfcf3: from storage DS-4af2f098-ebde-4a00-a62f-82a35c69fe02 node DatanodeRegistration(127.0.0.1:38191, datanodeUuid=f0b33787-61ce-4cbb-acb7-47cd28308fd3, infoPort=44309, infoSecurePort=0, ipcPort=46707, storageInfo=lv=-57;cid=testClusterID;nsid=2083037176;c=1676689266517), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:07,048 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x67e276bdfeacfcf3: Processing first storage report for DS-07243cc9-d6d7-4619-b2c2-b6ff80bbad5a from datanode f0b33787-61ce-4cbb-acb7-47cd28308fd3 2023-02-18 03:01:07,049 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x67e276bdfeacfcf3: from storage DS-07243cc9-d6d7-4619-b2c2-b6ff80bbad5a node DatanodeRegistration(127.0.0.1:38191, datanodeUuid=f0b33787-61ce-4cbb-acb7-47cd28308fd3, infoPort=44309, infoSecurePort=0, ipcPort=46707, storageInfo=lv=-57;cid=testClusterID;nsid=2083037176;c=1676689266517), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:07,091 DEBUG [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932 2023-02-18 03:01:07,093 INFO [Listener at localhost.localdomain/46707] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/zookeeper_0, clientPort=61613, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:01:07,094 INFO [Listener at localhost.localdomain/46707] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61613 2023-02-18 03:01:07,095 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,097 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,119 INFO [Listener at localhost.localdomain/46707] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c with version=8 2023-02-18 03:01:07,119 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,120 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,121 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/hbase-staging 2023-02-18 03:01:07,123 INFO [Listener at localhost.localdomain/46707] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:07,123 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,123 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,124 INFO [Listener at localhost.localdomain/46707] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:07,124 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,124 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:07,124 INFO [Listener at localhost.localdomain/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:07,126 INFO [Listener at localhost.localdomain/46707] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40981 2023-02-18 03:01:07,127 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,128 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,129 INFO [Listener at localhost.localdomain/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40981 connecting to ZooKeeper ensemble=127.0.0.1:61613 2023-02-18 03:01:07,139 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:409810x0, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:07,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40981-0x10173879b440000 connected 2023-02-18 03:01:07,171 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:07,172 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:07,172 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:07,179 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40981 2023-02-18 03:01:07,179 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40981 2023-02-18 03:01:07,180 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40981 2023-02-18 03:01:07,181 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40981 2023-02-18 03:01:07,181 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40981 2023-02-18 03:01:07,182 INFO [Listener at localhost.localdomain/46707] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c, hbase.cluster.distributed=false 2023-02-18 03:01:07,199 INFO [Listener at localhost.localdomain/46707] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:07,199 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,199 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,199 INFO [Listener at localhost.localdomain/46707] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:07,199 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,200 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:07,200 INFO [Listener at localhost.localdomain/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:07,203 INFO [Listener at localhost.localdomain/46707] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35525 2023-02-18 03:01:07,203 INFO [Listener at localhost.localdomain/46707] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:07,207 DEBUG [Listener at localhost.localdomain/46707] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:07,207 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,208 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,209 INFO [Listener at localhost.localdomain/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35525 connecting to ZooKeeper ensemble=127.0.0.1:61613 2023-02-18 03:01:07,212 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:355250x0, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:07,214 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): regionserver:355250x0, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:07,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35525-0x10173879b440001 connected 2023-02-18 03:01:07,215 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:07,215 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:07,219 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35525 2023-02-18 03:01:07,223 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35525 2023-02-18 03:01:07,223 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35525 2023-02-18 03:01:07,227 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35525 2023-02-18 03:01:07,228 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35525 2023-02-18 03:01:07,238 INFO [Listener at localhost.localdomain/46707] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:07,239 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,239 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,239 INFO [Listener at localhost.localdomain/46707] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:07,239 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:07,239 INFO [Listener at localhost.localdomain/46707] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:07,239 INFO [Listener at localhost.localdomain/46707] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:07,241 INFO [Listener at localhost.localdomain/46707] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39255 2023-02-18 03:01:07,241 INFO [Listener at localhost.localdomain/46707] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:07,243 DEBUG [Listener at localhost.localdomain/46707] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:07,243 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,245 INFO [Listener at localhost.localdomain/46707] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,246 INFO [Listener at localhost.localdomain/46707] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39255 connecting to ZooKeeper ensemble=127.0.0.1:61613 2023-02-18 03:01:07,249 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:392550x0, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:07,250 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): regionserver:392550x0, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:07,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39255-0x10173879b440002 connected 2023-02-18 03:01:07,251 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:07,252 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:07,255 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39255 2023-02-18 03:01:07,255 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39255 2023-02-18 03:01:07,255 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39255 2023-02-18 03:01:07,259 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39255 2023-02-18 03:01:07,259 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39255 2023-02-18 03:01:07,260 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,263 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:07,263 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,264 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:07,264 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:07,264 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:07,264 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,265 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:07,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,40981,1676689267123 from backup master directory 2023-02-18 03:01:07,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:07,267 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,268 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:07,268 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:07,268 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/hbase.id with ID: dabb03ae-301f-4b5d-8e17-727c935f754b 2023-02-18 03:01:07,303 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:07,305 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,323 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4d556fbe to 127.0.0.1:61613 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:07,327 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d9b7eb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:07,327 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:07,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:01:07,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:07,330 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store-tmp 2023-02-18 03:01:07,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:07,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:07,342 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:07,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:07,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:07,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:07,342 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:07,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:07,343 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/WALs/jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40981%2C1676689267123, suffix=, logDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/WALs/jenkins-hbase20.apache.org,40981,1676689267123, archiveDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/oldWALs, maxLogs=10 2023-02-18 03:01:07,362 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK] 2023-02-18 03:01:07,362 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK] 2023-02-18 03:01:07,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/WALs/jenkins-hbase20.apache.org,40981,1676689267123/jenkins-hbase20.apache.org%2C40981%2C1676689267123.1676689267346 2023-02-18 03:01:07,367 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK], DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK]] 2023-02-18 03:01:07,367 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:07,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:07,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:07,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:07,369 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:07,370 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:01:07,371 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:01:07,372 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,373 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:07,373 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:07,375 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:07,377 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:07,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58828110, jitterRate=-0.12339285016059875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:07,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:07,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:01:07,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:01:07,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:01:07,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:01:07,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 03:01:07,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 03:01:07,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:01:07,382 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:01:07,384 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:01:07,395 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:01:07,396 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:01:07,396 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:01:07,396 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:01:07,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:01:07,398 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:01:07,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:01:07,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:01:07,401 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:07,401 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:07,401 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:07,401 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,40981,1676689267123, sessionid=0x10173879b440000, setting cluster-up flag (Was=false) 2023-02-18 03:01:07,405 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:01:07,409 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,411 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,415 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:01:07,416 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:07,417 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.hbase-snapshot/.tmp 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:07,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689297423 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:01:07,424 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,424 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:07,424 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:01:07,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:01:07,426 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689267426,5,FailOnTimeoutGroup] 2023-02-18 03:01:07,426 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689267426,5,FailOnTimeoutGroup] 2023-02-18 03:01:07,426 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,426 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,435 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:07,435 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:07,435 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c 2023-02-18 03:01:07,444 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:07,445 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:07,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/info 2023-02-18 03:01:07,446 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:07,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,447 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:07,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:07,448 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:07,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:07,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/table 2023-02-18 03:01:07,451 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:07,451 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,452 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740 2023-02-18 03:01:07,452 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740 2023-02-18 03:01:07,454 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:07,456 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:07,457 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:07,458 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75031430, jitterRate=0.11805543303489685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:07,458 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:07,458 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:07,458 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:07,458 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:07,458 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:07,458 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:07,458 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:07,458 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:07,459 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:07,459 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:01:07,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:01:07,462 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:01:07,463 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(952): ClusterId : dabb03ae-301f-4b5d-8e17-727c935f754b 2023-02-18 03:01:07,463 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:07,463 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:01:07,463 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(952): ClusterId : dabb03ae-301f-4b5d-8e17-727c935f754b 2023-02-18 03:01:07,463 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:07,465 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:07,465 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:07,465 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:07,465 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:07,466 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:07,467 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:07,467 DEBUG [RS:0;jenkins-hbase20:35525] zookeeper.ReadOnlyZKClient(139): Connect 0x1f57f8a0 to 127.0.0.1:61613 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:07,468 DEBUG [RS:1;jenkins-hbase20:39255] zookeeper.ReadOnlyZKClient(139): Connect 0x57ccfa55 to 127.0.0.1:61613 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:07,483 DEBUG [RS:0;jenkins-hbase20:35525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1190153a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:07,483 DEBUG [RS:1;jenkins-hbase20:39255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@590b0edc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:07,483 DEBUG [RS:0;jenkins-hbase20:35525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15af93d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:07,483 DEBUG [RS:1;jenkins-hbase20:39255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d349125, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:07,495 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:35525 2023-02-18 03:01:07,495 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:39255 2023-02-18 03:01:07,496 INFO [RS:0;jenkins-hbase20:35525] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:07,496 INFO [RS:0;jenkins-hbase20:35525] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:07,496 INFO [RS:1;jenkins-hbase20:39255] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:07,496 INFO [RS:1;jenkins-hbase20:39255] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:07,496 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:07,496 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:07,496 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40981,1676689267123 with isa=jenkins-hbase20.apache.org/148.251.75.209:39255, startcode=1676689267238 2023-02-18 03:01:07,496 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40981,1676689267123 with isa=jenkins-hbase20.apache.org/148.251.75.209:35525, startcode=1676689267198 2023-02-18 03:01:07,497 DEBUG [RS:0;jenkins-hbase20:35525] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:07,497 DEBUG [RS:1;jenkins-hbase20:39255] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:07,502 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52661, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:07,502 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49685, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:07,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40981] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,505 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c 2023-02-18 03:01:07,505 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33221 2023-02-18 03:01:07,505 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:07,506 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:07,506 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c 2023-02-18 03:01:07,506 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33221 2023-02-18 03:01:07,506 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:07,509 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35525,1676689267198] 2023-02-18 03:01:07,509 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,39255,1676689267238] 2023-02-18 03:01:07,511 DEBUG [RS:0;jenkins-hbase20:35525] zookeeper.ZKUtil(162): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,511 WARN [RS:0;jenkins-hbase20:35525] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:07,511 INFO [RS:0;jenkins-hbase20:35525] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:07,512 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,512 DEBUG [RS:1;jenkins-hbase20:39255] zookeeper.ZKUtil(162): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,512 WARN [RS:1;jenkins-hbase20:39255] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:07,512 INFO [RS:1;jenkins-hbase20:39255] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:07,512 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,521 DEBUG [RS:0;jenkins-hbase20:35525] zookeeper.ZKUtil(162): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,522 DEBUG [RS:1;jenkins-hbase20:39255] zookeeper.ZKUtil(162): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,522 DEBUG [RS:0;jenkins-hbase20:35525] zookeeper.ZKUtil(162): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,522 DEBUG [RS:1;jenkins-hbase20:39255] zookeeper.ZKUtil(162): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,523 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:07,523 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:07,523 INFO [RS:0;jenkins-hbase20:35525] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:07,523 INFO [RS:1;jenkins-hbase20:39255] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:07,527 INFO [RS:0;jenkins-hbase20:35525] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:07,527 INFO [RS:1;jenkins-hbase20:39255] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:07,527 INFO [RS:0;jenkins-hbase20:35525] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:07,527 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,531 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:07,531 INFO [RS:1;jenkins-hbase20:39255] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:07,532 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,532 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:07,533 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:07,534 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,534 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,535 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,535 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,535 DEBUG [RS:0;jenkins-hbase20:35525] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,535 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,535 DEBUG [RS:1;jenkins-hbase20:39255] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:07,540 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,541 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,541 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,543 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,543 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,543 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,556 INFO [RS:1;jenkins-hbase20:39255] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:07,556 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39255,1676689267238-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,557 INFO [RS:0;jenkins-hbase20:35525] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:07,557 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35525,1676689267198-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,571 INFO [RS:1;jenkins-hbase20:39255] regionserver.Replication(203): jenkins-hbase20.apache.org,39255,1676689267238 started 2023-02-18 03:01:07,571 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,39255,1676689267238, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:39255, sessionid=0x10173879b440002 2023-02-18 03:01:07,571 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:07,571 DEBUG [RS:1;jenkins-hbase20:39255] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,571 DEBUG [RS:1;jenkins-hbase20:39255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39255,1676689267238' 2023-02-18 03:01:07,571 DEBUG [RS:1;jenkins-hbase20:39255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:07,571 DEBUG [RS:1;jenkins-hbase20:39255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:07,572 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:07,572 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:07,572 DEBUG [RS:1;jenkins-hbase20:39255] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:07,572 DEBUG [RS:1;jenkins-hbase20:39255] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39255,1676689267238' 2023-02-18 03:01:07,572 DEBUG [RS:1;jenkins-hbase20:39255] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:07,572 DEBUG [RS:1;jenkins-hbase20:39255] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:07,573 DEBUG [RS:1;jenkins-hbase20:39255] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:07,573 INFO [RS:1;jenkins-hbase20:39255] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:07,573 INFO [RS:1;jenkins-hbase20:39255] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:07,579 INFO [RS:0;jenkins-hbase20:35525] regionserver.Replication(203): jenkins-hbase20.apache.org,35525,1676689267198 started 2023-02-18 03:01:07,579 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,35525,1676689267198, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35525, sessionid=0x10173879b440001 2023-02-18 03:01:07,579 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:07,579 DEBUG [RS:0;jenkins-hbase20:35525] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,579 DEBUG [RS:0;jenkins-hbase20:35525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35525,1676689267198' 2023-02-18 03:01:07,579 DEBUG [RS:0;jenkins-hbase20:35525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:07,579 DEBUG [RS:0;jenkins-hbase20:35525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:07,580 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:07,580 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:07,580 DEBUG [RS:0;jenkins-hbase20:35525] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,580 DEBUG [RS:0;jenkins-hbase20:35525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35525,1676689267198' 2023-02-18 03:01:07,580 DEBUG [RS:0;jenkins-hbase20:35525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:07,580 DEBUG [RS:0;jenkins-hbase20:35525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:07,581 DEBUG [RS:0;jenkins-hbase20:35525] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:07,581 INFO [RS:0;jenkins-hbase20:35525] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:07,581 INFO [RS:0;jenkins-hbase20:35525] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:07,613 DEBUG [jenkins-hbase20:40981] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:01:07,613 DEBUG [jenkins-hbase20:40981] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:07,615 DEBUG [jenkins-hbase20:40981] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:07,616 DEBUG [jenkins-hbase20:40981] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:07,616 DEBUG [jenkins-hbase20:40981] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:07,617 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35525,1676689267198, state=OPENING 2023-02-18 03:01:07,621 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:01:07,622 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:07,623 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:07,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35525,1676689267198}] 2023-02-18 03:01:07,777 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:07,777 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:07,780 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60566, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:07,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:01:07,784 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:07,786 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35525%2C1676689267198.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,35525,1676689267198, archiveDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/oldWALs, maxLogs=32 2023-02-18 03:01:07,805 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK] 2023-02-18 03:01:07,805 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK] 2023-02-18 03:01:07,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,35525,1676689267198/jenkins-hbase20.apache.org%2C35525%2C1676689267198.meta.1676689267787.meta 2023-02-18 03:01:07,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK], DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK]] 2023-02-18 03:01:07,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:07,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:01:07,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:01:07,809 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:01:07,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:01:07,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:07,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:01:07,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:01:07,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:07,812 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/info 2023-02-18 03:01:07,812 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/info 2023-02-18 03:01:07,812 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:07,813 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,813 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:07,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:07,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:07,814 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:07,815 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,815 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:07,816 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/table 2023-02-18 03:01:07,816 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/table 2023-02-18 03:01:07,816 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:07,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:07,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740 2023-02-18 03:01:07,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740 2023-02-18 03:01:07,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:07,821 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:07,822 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66277729, jitterRate=-0.012384876608848572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:07,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:07,823 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689267777 2023-02-18 03:01:07,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:01:07,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:01:07,828 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35525,1676689267198, state=OPEN 2023-02-18 03:01:07,829 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:01:07,829 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:07,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:01:07,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35525,1676689267198 in 206 msec 2023-02-18 03:01:07,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:01:07,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 372 msec 2023-02-18 03:01:07,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 415 msec 2023-02-18 03:01:07,835 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689267835, completionTime=-1 2023-02-18 03:01:07,835 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:01:07,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:01:07,837 DEBUG [hconnection-0xc7d992d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:07,839 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60582, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:07,841 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:01:07,841 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689327841 2023-02-18 03:01:07,841 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689387841 2023-02-18 03:01:07,842 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40981,1676689267123-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40981,1676689267123-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40981,1676689267123-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:40981, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:01:07,848 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:07,850 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:01:07,850 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:01:07,852 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:07,853 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:07,855 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:07,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0 empty. 2023-02-18 03:01:07,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:07,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:01:07,874 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:07,875 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f3b307113cc3cccd94f20bdc297dcea0, NAME => 'hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f3b307113cc3cccd94f20bdc297dcea0, disabling compactions & flushes 2023-02-18 03:01:08,293 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. after waiting 0 ms 2023-02-18 03:01:08,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,293 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f3b307113cc3cccd94f20bdc297dcea0: 2023-02-18 03:01:08,296 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:08,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689268297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268297"}]},"ts":"1676689268297"} 2023-02-18 03:01:08,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:08,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:08,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689268301"}]},"ts":"1676689268301"} 2023-02-18 03:01:08,302 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:01:08,304 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:08,305 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:08,305 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:08,305 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:08,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f3b307113cc3cccd94f20bdc297dcea0, ASSIGN}] 2023-02-18 03:01:08,311 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f3b307113cc3cccd94f20bdc297dcea0, ASSIGN 2023-02-18 03:01:08,313 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f3b307113cc3cccd94f20bdc297dcea0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39255,1676689267238; forceNewPlan=false, retain=false 2023-02-18 03:01:08,463 INFO [jenkins-hbase20:40981] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:08,464 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f3b307113cc3cccd94f20bdc297dcea0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:08,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689268464"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689268464"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689268464"}]},"ts":"1676689268464"} 2023-02-18 03:01:08,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f3b307113cc3cccd94f20bdc297dcea0, server=jenkins-hbase20.apache.org,39255,1676689267238}] 2023-02-18 03:01:08,575 INFO [RS:1;jenkins-hbase20:39255] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39255%2C1676689267238, suffix=, logDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,39255,1676689267238, archiveDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/oldWALs, maxLogs=32 2023-02-18 03:01:08,583 INFO [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35525%2C1676689267198, suffix=, logDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,35525,1676689267198, archiveDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/oldWALs, maxLogs=32 2023-02-18 03:01:08,592 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK] 2023-02-18 03:01:08,592 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK] 2023-02-18 03:01:08,595 INFO [RS:1;jenkins-hbase20:39255] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,39255,1676689267238/jenkins-hbase20.apache.org%2C39255%2C1676689267238.1676689268576 2023-02-18 03:01:08,597 DEBUG [RS:1;jenkins-hbase20:39255] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK], DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK]] 2023-02-18 03:01:08,600 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK] 2023-02-18 03:01:08,601 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK] 2023-02-18 03:01:08,602 INFO [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,35525,1676689267198/jenkins-hbase20.apache.org%2C35525%2C1676689267198.1676689268583 2023-02-18 03:01:08,603 DEBUG [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37223,DS-c5db666e-812a-475f-bed2-3daf9a546e2c,DISK], DatanodeInfoWithStorage[127.0.0.1:38191,DS-4af2f098-ebde-4a00-a62f-82a35c69fe02,DISK]] 2023-02-18 03:01:08,618 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:08,618 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:08,621 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58058, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:08,625 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f3b307113cc3cccd94f20bdc297dcea0, NAME => 'hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:08,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,626 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,627 INFO [StoreOpener-f3b307113cc3cccd94f20bdc297dcea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,629 DEBUG [StoreOpener-f3b307113cc3cccd94f20bdc297dcea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/info 2023-02-18 03:01:08,629 DEBUG [StoreOpener-f3b307113cc3cccd94f20bdc297dcea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/info 2023-02-18 03:01:08,629 INFO [StoreOpener-f3b307113cc3cccd94f20bdc297dcea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3b307113cc3cccd94f20bdc297dcea0 columnFamilyName info 2023-02-18 03:01:08,630 INFO [StoreOpener-f3b307113cc3cccd94f20bdc297dcea0-1] regionserver.HStore(310): Store=f3b307113cc3cccd94f20bdc297dcea0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:08,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:08,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:08,638 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f3b307113cc3cccd94f20bdc297dcea0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63400596, jitterRate=-0.05525749921798706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:08,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f3b307113cc3cccd94f20bdc297dcea0: 2023-02-18 03:01:08,639 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0., pid=6, masterSystemTime=1676689268618 2023-02-18 03:01:08,642 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,643 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:08,644 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f3b307113cc3cccd94f20bdc297dcea0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:08,644 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689268644"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689268644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689268644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689268644"}]},"ts":"1676689268644"} 2023-02-18 03:01:08,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:01:08,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f3b307113cc3cccd94f20bdc297dcea0, server=jenkins-hbase20.apache.org,39255,1676689267238 in 180 msec 2023-02-18 03:01:08,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:01:08,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f3b307113cc3cccd94f20bdc297dcea0, ASSIGN in 343 msec 2023-02-18 03:01:08,651 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:08,651 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689268651"}]},"ts":"1676689268651"} 2023-02-18 03:01:08,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:01:08,654 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:08,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 805 msec 2023-02-18 03:01:08,751 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:01:08,752 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:08,752 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:08,755 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:08,756 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:08,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:01:08,767 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:08,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-18 03:01:08,781 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:01:08,789 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:08,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-18 03:01:08,805 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:01:08,806 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:01:08,806 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.538sec 2023-02-18 03:01:08,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:01:08,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:01:08,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:01:08,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40981,1676689267123-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:01:08,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40981,1676689267123-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:01:08,809 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:01:08,862 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ReadOnlyZKClient(139): Connect 0x531b01eb to 127.0.0.1:61613 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:08,867 DEBUG [Listener at localhost.localdomain/46707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@aa0c76d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:08,868 DEBUG [hconnection-0x16ad3752-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:08,872 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60592, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:08,873 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:08,873 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:01:08,877 DEBUG [Listener at localhost.localdomain/46707] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:01:08,879 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40582, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:01:08,880 INFO [Listener at localhost.localdomain/46707] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 03:01:08,881 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-18 03:01:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:01:08,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 148.251.75.209:40582 deadline: 1676689328880, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 03:01:08,881 INFO [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 03:01:08,884 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:08,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 03:01:08,888 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:08,888 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 03:01:08,888 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:08,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:08,896 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:08,896 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:08,896 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:08,896 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:08,896 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:08,896 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5 empty. 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5 empty. 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8 empty. 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354 empty. 2023-02-18 03:01:08,897 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd empty. 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f empty. 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6 empty. 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40 empty. 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba empty. 2023-02-18 03:01:08,898 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2 empty. 2023-02-18 03:01:08,899 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:08,899 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:08,899 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:08,899 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 03:01:08,910 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:08,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => efa3b3f5ef9565879657cc72b494750f, NAME => 'testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 85da828d2ac9cd27aa9ff19e83b84354, NAME => 'testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,912 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 15983e76d89189b89024beb1329c1cf5, NAME => 'testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,925 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 15983e76d89189b89024beb1329c1cf5, disabling compactions & flushes 2023-02-18 03:01:08,925 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:08,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:08,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. after waiting 0 ms 2023-02-18 03:01:08,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:08,926 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:08,926 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:08,926 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b9b0d8d2f16292944eabf0ce19c83c5, NAME => 'testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing efa3b3f5ef9565879657cc72b494750f, disabling compactions & flushes 2023-02-18 03:01:08,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:08,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:08,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. after waiting 0 ms 2023-02-18 03:01:08,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:08,931 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:08,931 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:08,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 85da828d2ac9cd27aa9ff19e83b84354, disabling compactions & flushes 2023-02-18 03:01:08,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:08,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:08,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 03353b3c1856686327ea5f91d22a38e8, NAME => 'testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. after waiting 0 ms 2023-02-18 03:01:08,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:08,932 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:08,932 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:08,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ded38d4918dc3b545c687aa0624389dd, NAME => 'testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2b9b0d8d2f16292944eabf0ce19c83c5, disabling compactions & flushes 2023-02-18 03:01:08,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:08,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:08,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. after waiting 0 ms 2023-02-18 03:01:08,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:08,933 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:08,933 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:08,934 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e4822485b4615bcd402b16297c6bfd40, NAME => 'testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 03353b3c1856686327ea5f91d22a38e8, disabling compactions & flushes 2023-02-18 03:01:08,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:08,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:08,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. after waiting 0 ms 2023-02-18 03:01:08,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:08,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:08,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:08,946 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 76b154ebf4a37945dfa5aa34d575dcb6, NAME => 'testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,949 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,949 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ded38d4918dc3b545c687aa0624389dd, disabling compactions & flushes 2023-02-18 03:01:08,950 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:08,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:08,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. after waiting 0 ms 2023-02-18 03:01:08,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:08,950 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:08,950 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:08,950 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 36f7080bca7b4513f43ddcc675d32ac2, NAME => 'testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e4822485b4615bcd402b16297c6bfd40, disabling compactions & flushes 2023-02-18 03:01:08,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:08,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:08,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. after waiting 0 ms 2023-02-18 03:01:08,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:08,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:08,952 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:08,952 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3398a6bf7d3ad44093adaa9d19e1caba, NAME => 'testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.tmp 2023-02-18 03:01:08,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 76b154ebf4a37945dfa5aa34d575dcb6, disabling compactions & flushes 2023-02-18 03:01:08,956 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:08,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:08,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. after waiting 0 ms 2023-02-18 03:01:08,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:08,956 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:08,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:08,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 36f7080bca7b4513f43ddcc675d32ac2, disabling compactions & flushes 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3398a6bf7d3ad44093adaa9d19e1caba, disabling compactions & flushes 2023-02-18 03:01:08,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:08,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. after waiting 0 ms 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. after waiting 0 ms 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:08,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:08,962 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:08,962 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:08,964 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689268965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689268965"}]},"ts":"1676689268965"} 2023-02-18 03:01:08,972 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 03:01:08,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:08,973 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689268973"}]},"ts":"1676689268973"} 2023-02-18 03:01:08,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 03:01:08,977 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:08,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:08,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:08,985 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:08,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15983e76d89189b89024beb1329c1cf5, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=85da828d2ac9cd27aa9ff19e83b84354, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=efa3b3f5ef9565879657cc72b494750f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b0d8d2f16292944eabf0ce19c83c5, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=03353b3c1856686327ea5f91d22a38e8, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ded38d4918dc3b545c687aa0624389dd, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e4822485b4615bcd402b16297c6bfd40, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=76b154ebf4a37945dfa5aa34d575dcb6, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=36f7080bca7b4513f43ddcc675d32ac2, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3398a6bf7d3ad44093adaa9d19e1caba, ASSIGN}] 2023-02-18 03:01:08,988 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=03353b3c1856686327ea5f91d22a38e8, ASSIGN 2023-02-18 03:01:08,988 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=efa3b3f5ef9565879657cc72b494750f, ASSIGN 2023-02-18 03:01:08,988 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b0d8d2f16292944eabf0ce19c83c5, ASSIGN 2023-02-18 03:01:08,988 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=85da828d2ac9cd27aa9ff19e83b84354, ASSIGN 2023-02-18 03:01:08,989 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=03353b3c1856686327ea5f91d22a38e8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35525,1676689267198; forceNewPlan=false, retain=false 2023-02-18 03:01:08,989 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=efa3b3f5ef9565879657cc72b494750f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39255,1676689267238; forceNewPlan=false, retain=false 2023-02-18 03:01:08,989 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=85da828d2ac9cd27aa9ff19e83b84354, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35525,1676689267198; forceNewPlan=false, retain=false 2023-02-18 03:01:08,989 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3398a6bf7d3ad44093adaa9d19e1caba, ASSIGN 2023-02-18 03:01:08,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b0d8d2f16292944eabf0ce19c83c5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39255,1676689267238; forceNewPlan=false, retain=false 2023-02-18 03:01:08,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:08,991 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=36f7080bca7b4513f43ddcc675d32ac2, ASSIGN 2023-02-18 03:01:08,991 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=76b154ebf4a37945dfa5aa34d575dcb6, ASSIGN 2023-02-18 03:01:08,991 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e4822485b4615bcd402b16297c6bfd40, ASSIGN 2023-02-18 03:01:08,991 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ded38d4918dc3b545c687aa0624389dd, ASSIGN 2023-02-18 03:01:08,992 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3398a6bf7d3ad44093adaa9d19e1caba, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39255,1676689267238; forceNewPlan=false, retain=false 2023-02-18 03:01:08,992 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=36f7080bca7b4513f43ddcc675d32ac2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35525,1676689267198; forceNewPlan=false, retain=false 2023-02-18 03:01:08,992 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e4822485b4615bcd402b16297c6bfd40, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35525,1676689267198; forceNewPlan=false, retain=false 2023-02-18 03:01:08,992 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=76b154ebf4a37945dfa5aa34d575dcb6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39255,1676689267238; forceNewPlan=false, retain=false 2023-02-18 03:01:08,992 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ded38d4918dc3b545c687aa0624389dd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39255,1676689267238; forceNewPlan=false, retain=false 2023-02-18 03:01:08,993 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15983e76d89189b89024beb1329c1cf5, ASSIGN 2023-02-18 03:01:08,993 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=15983e76d89189b89024beb1329c1cf5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35525,1676689267198; forceNewPlan=false, retain=false 2023-02-18 03:01:09,140 INFO [jenkins-hbase20:40981] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 03:01:09,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=76b154ebf4a37945dfa5aa34d575dcb6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ded38d4918dc3b545c687aa0624389dd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=efa3b3f5ef9565879657cc72b494750f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,144 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269144"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269144"}]},"ts":"1676689269144"} 2023-02-18 03:01:09,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269144"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269144"}]},"ts":"1676689269144"} 2023-02-18 03:01:09,144 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2b9b0d8d2f16292944eabf0ce19c83c5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,144 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3398a6bf7d3ad44093adaa9d19e1caba, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,145 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269144"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269144"}]},"ts":"1676689269144"} 2023-02-18 03:01:09,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269144"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269144"}]},"ts":"1676689269144"} 2023-02-18 03:01:09,145 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689269144"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269144"}]},"ts":"1676689269144"} 2023-02-18 03:01:09,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure 76b154ebf4a37945dfa5aa34d575dcb6, server=jenkins-hbase20.apache.org,39255,1676689267238}] 2023-02-18 03:01:09,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure efa3b3f5ef9565879657cc72b494750f, server=jenkins-hbase20.apache.org,39255,1676689267238}] 2023-02-18 03:01:09,148 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure 2b9b0d8d2f16292944eabf0ce19c83c5, server=jenkins-hbase20.apache.org,39255,1676689267238}] 2023-02-18 03:01:09,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure ded38d4918dc3b545c687aa0624389dd, server=jenkins-hbase20.apache.org,39255,1676689267238}] 2023-02-18 03:01:09,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 3398a6bf7d3ad44093adaa9d19e1caba, server=jenkins-hbase20.apache.org,39255,1676689267238}] 2023-02-18 03:01:09,152 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e4822485b4615bcd402b16297c6bfd40, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=03353b3c1856686327ea5f91d22a38e8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269152"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269152"}]},"ts":"1676689269152"} 2023-02-18 03:01:09,152 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269152"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269152"}]},"ts":"1676689269152"} 2023-02-18 03:01:09,153 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=85da828d2ac9cd27aa9ff19e83b84354, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269153"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269153"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269153"}]},"ts":"1676689269153"} 2023-02-18 03:01:09,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure 03353b3c1856686327ea5f91d22a38e8, server=jenkins-hbase20.apache.org,35525,1676689267198}] 2023-02-18 03:01:09,157 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=36f7080bca7b4513f43ddcc675d32ac2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269157"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269157"}]},"ts":"1676689269157"} 2023-02-18 03:01:09,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=15983e76d89189b89024beb1329c1cf5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689269159"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689269159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689269159"}]},"ts":"1676689269159"} 2023-02-18 03:01:09,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 85da828d2ac9cd27aa9ff19e83b84354, server=jenkins-hbase20.apache.org,35525,1676689267198}] 2023-02-18 03:01:09,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure e4822485b4615bcd402b16297c6bfd40, server=jenkins-hbase20.apache.org,35525,1676689267198}] 2023-02-18 03:01:09,166 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 36f7080bca7b4513f43ddcc675d32ac2, server=jenkins-hbase20.apache.org,35525,1676689267198}] 2023-02-18 03:01:09,168 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 15983e76d89189b89024beb1329c1cf5, server=jenkins-hbase20.apache.org,35525,1676689267198}] 2023-02-18 03:01:09,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:09,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 76b154ebf4a37945dfa5aa34d575dcb6, NAME => 'testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 03:01:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,304 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,306 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1 2023-02-18 03:01:09,306 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1 2023-02-18 03:01:09,306 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76b154ebf4a37945dfa5aa34d575dcb6 columnFamilyName f1 2023-02-18 03:01:09,307 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(310): Store=76b154ebf4a37945dfa5aa34d575dcb6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,307 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,308 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2 2023-02-18 03:01:09,308 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2 2023-02-18 03:01:09,309 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76b154ebf4a37945dfa5aa34d575dcb6 columnFamilyName f2 2023-02-18 03:01:09,309 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(310): Store=76b154ebf4a37945dfa5aa34d575dcb6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 15983e76d89189b89024beb1329c1cf5, NAME => 'testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 03:01:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:09,314 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,315 DEBUG [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/f1 2023-02-18 03:01:09,316 DEBUG [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/f1 2023-02-18 03:01:09,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 76b154ebf4a37945dfa5aa34d575dcb6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62612758, jitterRate=-0.06699720025062561}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,316 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15983e76d89189b89024beb1329c1cf5 columnFamilyName f1 2023-02-18 03:01:09,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:09,316 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(310): Store=15983e76d89189b89024beb1329c1cf5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,317 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6., pid=21, masterSystemTime=1676689269299 2023-02-18 03:01:09,318 DEBUG [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/f2 2023-02-18 03:01:09,318 DEBUG [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/f2 2023-02-18 03:01:09,318 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15983e76d89189b89024beb1329c1cf5 columnFamilyName f2 2023-02-18 03:01:09,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:09,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:09,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:09,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b9b0d8d2f16292944eabf0ce19c83c5, NAME => 'testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 03:01:09,319 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(310): Store=15983e76d89189b89024beb1329c1cf5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=76b154ebf4a37945dfa5aa34d575dcb6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,319 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269319"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269319"}]},"ts":"1676689269319"} 2023-02-18 03:01:09,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,321 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,323 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1 2023-02-18 03:01:09,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-18 03:01:09,324 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1 2023-02-18 03:01:09,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure 76b154ebf4a37945dfa5aa34d575dcb6, server=jenkins-hbase20.apache.org,39255,1676689267238 in 175 msec 2023-02-18 03:01:09,324 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b0d8d2f16292944eabf0ce19c83c5 columnFamilyName f1 2023-02-18 03:01:09,325 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(310): Store=2b9b0d8d2f16292944eabf0ce19c83c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,325 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=76b154ebf4a37945dfa5aa34d575dcb6, ASSIGN in 338 msec 2023-02-18 03:01:09,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:09,326 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2 2023-02-18 03:01:09,327 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2 2023-02-18 03:01:09,327 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b0d8d2f16292944eabf0ce19c83c5 columnFamilyName f2 2023-02-18 03:01:09,327 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(310): Store=2b9b0d8d2f16292944eabf0ce19c83c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 15983e76d89189b89024beb1329c1cf5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61733655, jitterRate=-0.08009685575962067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:09,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5., pid=30, masterSystemTime=1676689269309 2023-02-18 03:01:09,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:09,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:09,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 36f7080bca7b4513f43ddcc675d32ac2, NAME => 'testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 03:01:09,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=15983e76d89189b89024beb1329c1cf5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,332 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689269332"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269332"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269332"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269332"}]},"ts":"1676689269332"} 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:09,334 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,335 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1 2023-02-18 03:01:09,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-18 03:01:09,336 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1 2023-02-18 03:01:09,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 15983e76d89189b89024beb1329c1cf5, server=jenkins-hbase20.apache.org,35525,1676689267198 in 166 msec 2023-02-18 03:01:09,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 2b9b0d8d2f16292944eabf0ce19c83c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59717111, jitterRate=-0.110145702958107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:09,336 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36f7080bca7b4513f43ddcc675d32ac2 columnFamilyName f1 2023-02-18 03:01:09,337 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(310): Store=36f7080bca7b4513f43ddcc675d32ac2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5., pid=23, masterSystemTime=1676689269299 2023-02-18 03:01:09,337 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15983e76d89189b89024beb1329c1cf5, ASSIGN in 350 msec 2023-02-18 03:01:09,338 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2 2023-02-18 03:01:09,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:09,338 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2 2023-02-18 03:01:09,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:09,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:09,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => efa3b3f5ef9565879657cc72b494750f, NAME => 'testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 03:01:09,338 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2b9b0d8d2f16292944eabf0ce19c83c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,339 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36f7080bca7b4513f43ddcc675d32ac2 columnFamilyName f2 2023-02-18 03:01:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,339 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269338"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269338"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269338"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269338"}]},"ts":"1676689269338"} 2023-02-18 03:01:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,339 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(310): Store=36f7080bca7b4513f43ddcc675d32ac2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,340 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,341 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1 2023-02-18 03:01:09,341 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1 2023-02-18 03:01:09,342 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efa3b3f5ef9565879657cc72b494750f columnFamilyName f1 2023-02-18 03:01:09,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-18 03:01:09,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure 2b9b0d8d2f16292944eabf0ce19c83c5, server=jenkins-hbase20.apache.org,39255,1676689267238 in 192 msec 2023-02-18 03:01:09,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,343 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(310): Store=efa3b3f5ef9565879657cc72b494750f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,343 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2b9b0d8d2f16292944eabf0ce19c83c5, ASSIGN in 356 msec 2023-02-18 03:01:09,343 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:09,344 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2 2023-02-18 03:01:09,344 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2 2023-02-18 03:01:09,344 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efa3b3f5ef9565879657cc72b494750f columnFamilyName f2 2023-02-18 03:01:09,345 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(310): Store=efa3b3f5ef9565879657cc72b494750f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 36f7080bca7b4513f43ddcc675d32ac2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59937012, jitterRate=-0.1068689227104187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:09,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2., pid=29, masterSystemTime=1676689269309 2023-02-18 03:01:09,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:09,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:09,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:09,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4822485b4615bcd402b16297c6bfd40, NAME => 'testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 03:01:09,348 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=36f7080bca7b4513f43ddcc675d32ac2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,348 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269348"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269348"}]},"ts":"1676689269348"} 2023-02-18 03:01:09,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:09,350 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,351 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1 2023-02-18 03:01:09,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,352 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1 2023-02-18 03:01:09,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-18 03:01:09,352 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4822485b4615bcd402b16297c6bfd40 columnFamilyName f1 2023-02-18 03:01:09,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 36f7080bca7b4513f43ddcc675d32ac2, server=jenkins-hbase20.apache.org,35525,1676689267198 in 184 msec 2023-02-18 03:01:09,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened efa3b3f5ef9565879657cc72b494750f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68828777, jitterRate=0.025628700852394104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:09,353 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(310): Store=e4822485b4615bcd402b16297c6bfd40/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,353 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f., pid=22, masterSystemTime=1676689269299 2023-02-18 03:01:09,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=36f7080bca7b4513f43ddcc675d32ac2, ASSIGN in 366 msec 2023-02-18 03:01:09,354 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2 2023-02-18 03:01:09,354 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2 2023-02-18 03:01:09,354 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4822485b4615bcd402b16297c6bfd40 columnFamilyName f2 2023-02-18 03:01:09,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:09,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:09,355 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(310): Store=e4822485b4615bcd402b16297c6bfd40/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:09,355 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=efa3b3f5ef9565879657cc72b494750f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ded38d4918dc3b545c687aa0624389dd, NAME => 'testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 03:01:09,355 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269355"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269355"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269355"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269355"}]},"ts":"1676689269355"} 2023-02-18 03:01:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,358 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-18 03:01:09,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure efa3b3f5ef9565879657cc72b494750f, server=jenkins-hbase20.apache.org,39255,1676689267238 in 210 msec 2023-02-18 03:01:09,359 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1 2023-02-18 03:01:09,360 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1 2023-02-18 03:01:09,360 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded38d4918dc3b545c687aa0624389dd columnFamilyName f1 2023-02-18 03:01:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=efa3b3f5ef9565879657cc72b494750f, ASSIGN in 373 msec 2023-02-18 03:01:09,361 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(310): Store=ded38d4918dc3b545c687aa0624389dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,361 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:09,362 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2 2023-02-18 03:01:09,362 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2 2023-02-18 03:01:09,363 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded38d4918dc3b545c687aa0624389dd columnFamilyName f2 2023-02-18 03:01:09,364 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(310): Store=ded38d4918dc3b545c687aa0624389dd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened e4822485b4615bcd402b16297c6bfd40; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68765675, jitterRate=0.02468840777873993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:09,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:09,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened ded38d4918dc3b545c687aa0624389dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59104321, jitterRate=-0.1192769855260849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:09,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40., pid=28, masterSystemTime=1676689269309 2023-02-18 03:01:09,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd., pid=24, masterSystemTime=1676689269299 2023-02-18 03:01:09,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:09,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:09,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:09,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 85da828d2ac9cd27aa9ff19e83b84354, NAME => 'testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 03:01:09,372 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=e4822485b4615bcd402b16297c6bfd40, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,373 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269372"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269372"}]},"ts":"1676689269372"} 2023-02-18 03:01:09,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,374 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ded38d4918dc3b545c687aa0624389dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,374 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269374"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269374"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269374"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269374"}]},"ts":"1676689269374"} 2023-02-18 03:01:09,376 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:09,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:09,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:09,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3398a6bf7d3ad44093adaa9d19e1caba, NAME => 'testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 03:01:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-18 03:01:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure e4822485b4615bcd402b16297c6bfd40, server=jenkins-hbase20.apache.org,35525,1676689267198 in 208 msec 2023-02-18 03:01:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,378 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1 2023-02-18 03:01:09,378 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1 2023-02-18 03:01:09,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e4822485b4615bcd402b16297c6bfd40, ASSIGN in 391 msec 2023-02-18 03:01:09,379 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85da828d2ac9cd27aa9ff19e83b84354 columnFamilyName f1 2023-02-18 03:01:09,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-18 03:01:09,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure ded38d4918dc3b545c687aa0624389dd, server=jenkins-hbase20.apache.org,39255,1676689267238 in 226 msec 2023-02-18 03:01:09,380 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(310): Store=85da828d2ac9cd27aa9ff19e83b84354/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,380 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ded38d4918dc3b545c687aa0624389dd, ASSIGN in 393 msec 2023-02-18 03:01:09,383 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,384 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2 2023-02-18 03:01:09,384 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2 2023-02-18 03:01:09,384 DEBUG [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/f1 2023-02-18 03:01:09,384 DEBUG [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/f1 2023-02-18 03:01:09,384 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85da828d2ac9cd27aa9ff19e83b84354 columnFamilyName f2 2023-02-18 03:01:09,384 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3398a6bf7d3ad44093adaa9d19e1caba columnFamilyName f1 2023-02-18 03:01:09,385 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(310): Store=85da828d2ac9cd27aa9ff19e83b84354/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,385 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(310): Store=3398a6bf7d3ad44093adaa9d19e1caba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,385 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,386 DEBUG [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/f2 2023-02-18 03:01:09,386 DEBUG [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/f2 2023-02-18 03:01:09,387 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3398a6bf7d3ad44093adaa9d19e1caba columnFamilyName f2 2023-02-18 03:01:09,387 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(310): Store=3398a6bf7d3ad44093adaa9d19e1caba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:09,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:09,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 85da828d2ac9cd27aa9ff19e83b84354; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74391803, jitterRate=0.10852424800395966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:09,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354., pid=27, masterSystemTime=1676689269309 2023-02-18 03:01:09,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 3398a6bf7d3ad44093adaa9d19e1caba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70879832, jitterRate=0.05619180202484131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:09,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:09,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba., pid=25, masterSystemTime=1676689269299 2023-02-18 03:01:09,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:09,395 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=85da828d2ac9cd27aa9ff19e83b84354, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 03353b3c1856686327ea5f91d22a38e8, NAME => 'testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 03:01:09,396 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269395"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269395"}]},"ts":"1676689269395"} 2023-02-18 03:01:09,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:09,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:09,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:09,399 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=3398a6bf7d3ad44093adaa9d19e1caba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,399 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676689269398"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269398"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269398"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269398"}]},"ts":"1676689269398"} 2023-02-18 03:01:09,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-18 03:01:09,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 85da828d2ac9cd27aa9ff19e83b84354, server=jenkins-hbase20.apache.org,35525,1676689267198 in 233 msec 2023-02-18 03:01:09,400 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=85da828d2ac9cd27aa9ff19e83b84354, ASSIGN in 414 msec 2023-02-18 03:01:09,402 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1 2023-02-18 03:01:09,402 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1 2023-02-18 03:01:09,402 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03353b3c1856686327ea5f91d22a38e8 columnFamilyName f1 2023-02-18 03:01:09,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-18 03:01:09,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 3398a6bf7d3ad44093adaa9d19e1caba, server=jenkins-hbase20.apache.org,39255,1676689267238 in 248 msec 2023-02-18 03:01:09,403 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(310): Store=03353b3c1856686327ea5f91d22a38e8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,403 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3398a6bf7d3ad44093adaa9d19e1caba, ASSIGN in 417 msec 2023-02-18 03:01:09,405 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2 2023-02-18 03:01:09,405 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2 2023-02-18 03:01:09,405 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03353b3c1856686327ea5f91d22a38e8 columnFamilyName f2 2023-02-18 03:01:09,405 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(310): Store=03353b3c1856686327ea5f91d22a38e8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:09,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:09,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:09,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:09,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 03353b3c1856686327ea5f91d22a38e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63517973, jitterRate=-0.053508445620536804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:09,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:09,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8., pid=26, masterSystemTime=1676689269309 2023-02-18 03:01:09,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:09,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:09,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=03353b3c1856686327ea5f91d22a38e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,414 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676689269414"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689269414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689269414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689269414"}]},"ts":"1676689269414"} 2023-02-18 03:01:09,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-18 03:01:09,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure 03353b3c1856686327ea5f91d22a38e8, server=jenkins-hbase20.apache.org,35525,1676689267198 in 261 msec 2023-02-18 03:01:09,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-18 03:01:09,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=03353b3c1856686327ea5f91d22a38e8, ASSIGN in 432 msec 2023-02-18 03:01:09,420 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:09,420 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689269420"}]},"ts":"1676689269420"} 2023-02-18 03:01:09,422 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 03:01:09,424 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:09,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 540 msec 2023-02-18 03:01:09,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:09,494 INFO [Listener at localhost.localdomain/46707] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 03:01:09,494 DEBUG [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 03:01:09,494 INFO [Listener at localhost.localdomain/46707] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:09,499 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 03:01:09,499 INFO [Listener at localhost.localdomain/46707] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:09,499 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 03:01:09,499 INFO [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:01:09,575 DEBUG [hconnection-0x16ad3752-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:09,592 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:09,595 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:09,598 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:09,723 INFO [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:01:09,723 INFO [Listener at localhost.localdomain/46707] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:01:09,726 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:01:09,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689269726 (current time:1676689269726). 2023-02-18 03:01:09,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:01:09,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] zookeeper.ReadOnlyZKClient(139): Connect 0x2eef13fc to 127.0.0.1:61613 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:09,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e16315b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:09,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:09,752 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:09,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eef13fc to 127.0.0.1:61613 2023-02-18 03:01:09,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:09,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:01:09,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:01:09,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:01:09,757 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:01:09,758 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676689869758 2023-02-18 03:01:09,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:01:09,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 03:01:09,759 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:09,761 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:01:09,761 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:01:09,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:01:09,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-18 03:01:09,764 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:01:09,765 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676689869765 2023-02-18 03:01:09,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,789 INFO [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-18 03:01:09,790 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:09,790 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-18 03:01:09,790 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-18 03:01:09,791 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,791 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,792 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:09,792 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:09,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:09,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:09,792 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,793 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,793 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-18 03:01:09,795 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,795 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:09,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,799 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-18 03:01:09,799 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:09,799 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-18 03:01:09,800 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-18 03:01:09,800 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-18 03:01:09,800 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:09,800 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39255,1676689267238' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-18 03:01:09,803 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-18 03:01:09,807 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-18 03:01:09,808 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35525,1676689267198' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-18 03:01:09,808 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,808 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:09,809 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,809 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,809 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:09,809 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:09,809 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,809 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:09,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:09,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39255,1676689267238' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-18 03:01:09,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b67f02[Count = 1] remaining members to acquire global barrier 2023-02-18 03:01:09,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:09,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:09,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:09,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:09,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:09,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35525,1676689267198' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-18 03:01:09,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b67f02[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:09,818 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-18 03:01:09,818 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-18 03:01:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,824 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-18 03:01:09,824 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:09,824 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:09,829 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:09,830 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. started... 2023-02-18 03:01:09,831 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 76b154ebf4a37945dfa5aa34d575dcb6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:09,835 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:09,835 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. started... 2023-02-18 03:01:09,839 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 03:01:09,839 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:09,839 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:09,843 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:09,843 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 03:01:09,843 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:09,843 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. started... 2023-02-18 03:01:09,840 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:09,844 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. started... 2023-02-18 03:01:09,840 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ded38d4918dc3b545c687aa0624389dd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:09,839 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. started... 2023-02-18 03:01:09,846 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e4822485b4615bcd402b16297c6bfd40 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:09,844 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 36f7080bca7b4513f43ddcc675d32ac2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 03:01:09,850 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:09,843 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:09,843 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. started... 2023-02-18 03:01:09,852 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:09,852 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:09,852 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:09,852 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:09,856 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 85da828d2ac9cd27aa9ff19e83b84354 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 03:01:09,861 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:09,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:09,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:09,864 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:01:09,923 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f1/a30473dbf8994b4d9a2c9cb85e9349a7 2023-02-18 03:01:09,927 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. completed. 2023-02-18 03:01:09,927 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:09,927 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:09,927 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 03:01:09,927 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. started... 2023-02-18 03:01:09,959 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2b9b0d8d2f16292944eabf0ce19c83c5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:09,967 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f1/89fbc891ced546f8a9291eb391c1fa33 2023-02-18 03:01:10,001 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f1/499e27d352c247dbabe96dd75b8400b8 2023-02-18 03:01:10,023 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f1/95b474876e4e4a0a9807adef799d7b52 2023-02-18 03:01:10,040 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f1/f1fe03d9e8b747d4ad078a948a0fa5fa 2023-02-18 03:01:10,064 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:10,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:10,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:10,066 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 03:01:10,123 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f2/d75f0030e5a84cd0af11ce61accef65a 2023-02-18 03:01:10,125 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f1/08eaff8e373a442189988f222f4b5dd6 2023-02-18 03:01:10,140 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f1/a30473dbf8994b4d9a2c9cb85e9349a7 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/a30473dbf8994b4d9a2c9cb85e9349a7 2023-02-18 03:01:10,143 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 03:01:10,150 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/a30473dbf8994b4d9a2c9cb85e9349a7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,155 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f2/d75f0030e5a84cd0af11ce61accef65a as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/d75f0030e5a84cd0af11ce61accef65a 2023-02-18 03:01:10,159 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f2/5d25514e842c44bb892bf70711609f36 2023-02-18 03:01:10,191 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f2/0c438eaecd6f4ab5aaef41bc07be9a53 2023-02-18 03:01:10,261 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/d75f0030e5a84cd0af11ce61accef65a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,263 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 76b154ebf4a37945dfa5aa34d575dcb6 in 432ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,263 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-18 03:01:10,263 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f1/95b474876e4e4a0a9807adef799d7b52 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/95b474876e4e4a0a9807adef799d7b52 2023-02-18 03:01:10,264 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f1/499e27d352c247dbabe96dd75b8400b8 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/499e27d352c247dbabe96dd75b8400b8 2023-02-18 03:01:10,264 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:10,264 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,265 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,265 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/a30473dbf8994b4d9a2c9cb85e9349a7] hfiles 2023-02-18 03:01:10,265 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/a30473dbf8994b4d9a2c9cb85e9349a7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,265 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/d75f0030e5a84cd0af11ce61accef65a] hfiles 2023-02-18 03:01:10,265 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/d75f0030e5a84cd0af11ce61accef65a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,267 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f2/e4fa93df656b4db5a115f804d17eb284 2023-02-18 03:01:10,274 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/499e27d352c247dbabe96dd75b8400b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,275 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f2/5d25514e842c44bb892bf70711609f36 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/5d25514e842c44bb892bf70711609f36 2023-02-18 03:01:10,275 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/95b474876e4e4a0a9807adef799d7b52, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,277 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f2/0c438eaecd6f4ab5aaef41bc07be9a53 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/0c438eaecd6f4ab5aaef41bc07be9a53 2023-02-18 03:01:10,293 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f1/08eaff8e373a442189988f222f4b5dd6 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/08eaff8e373a442189988f222f4b5dd6 2023-02-18 03:01:10,312 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/0c438eaecd6f4ab5aaef41bc07be9a53, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,313 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/5d25514e842c44bb892bf70711609f36, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,313 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/08eaff8e373a442189988f222f4b5dd6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,313 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e4822485b4615bcd402b16297c6bfd40 in 467ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,313 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ded38d4918dc3b545c687aa0624389dd in 473ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,314 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:10,355 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:10,355 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,358 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,358 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,361 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/499e27d352c247dbabe96dd75b8400b8] hfiles 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/499e27d352c247dbabe96dd75b8400b8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/5d25514e842c44bb892bf70711609f36] hfiles 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/5d25514e842c44bb892bf70711609f36 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,363 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/95b474876e4e4a0a9807adef799d7b52] hfiles 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/95b474876e4e4a0a9807adef799d7b52 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/0c438eaecd6f4ab5aaef41bc07be9a53] hfiles 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/0c438eaecd6f4ab5aaef41bc07be9a53 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,364 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f2/e4fa93df656b4db5a115f804d17eb284 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/e4fa93df656b4db5a115f804d17eb284 2023-02-18 03:01:10,366 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:10,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:10,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:10,368 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 03:01:10,390 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/e4fa93df656b4db5a115f804d17eb284, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,393 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2b9b0d8d2f16292944eabf0ce19c83c5 in 434ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/08eaff8e373a442189988f222f4b5dd6] hfiles 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/08eaff8e373a442189988f222f4b5dd6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/e4fa93df656b4db5a115f804d17eb284] hfiles 2023-02-18 03:01:10,393 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/e4fa93df656b4db5a115f804d17eb284 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,608 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f2/02b053c529fb4fd8ab050473cf2585d7 2023-02-18 03:01:10,613 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. completed. 2023-02-18 03:01:10,613 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:10,613 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:10,613 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 03:01:10,613 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. started... 2023-02-18 03:01:10,613 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegion(2744): Flushing efa3b3f5ef9565879657cc72b494750f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:10,617 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. completed. 2023-02-18 03:01:10,617 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:10,617 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:10,617 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 03:01:10,617 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. started... 2023-02-18 03:01:10,617 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 03353b3c1856686327ea5f91d22a38e8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:10,618 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. completed. 2023-02-18 03:01:10,618 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:10,618 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 03:01:10,620 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f1/89fbc891ced546f8a9291eb391c1fa33 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/89fbc891ced546f8a9291eb391c1fa33 2023-02-18 03:01:10,640 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/89fbc891ced546f8a9291eb391c1fa33, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:10,642 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f2/02b053c529fb4fd8ab050473cf2585d7 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/02b053c529fb4fd8ab050473cf2585d7 2023-02-18 03:01:10,651 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f1/09ab55b867504245b97649b07a915827 2023-02-18 03:01:10,653 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f1/22ddfc01752e450889b55c847984ae95 2023-02-18 03:01:10,657 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/02b053c529fb4fd8ab050473cf2585d7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:10,659 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 36f7080bca7b4513f43ddcc675d32ac2 in 814ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/89fbc891ced546f8a9291eb391c1fa33] hfiles 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/89fbc891ced546f8a9291eb391c1fa33 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/02b053c529fb4fd8ab050473cf2585d7] hfiles 2023-02-18 03:01:10,659 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/02b053c529fb4fd8ab050473cf2585d7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,671 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f2/8e893b4c303341188f9bb1fe6ea9ebc4 2023-02-18 03:01:10,677 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f1/f1fe03d9e8b747d4ad078a948a0fa5fa as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/f1fe03d9e8b747d4ad078a948a0fa5fa 2023-02-18 03:01:10,683 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/f1fe03d9e8b747d4ad078a948a0fa5fa, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:10,684 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f2/8e893b4c303341188f9bb1fe6ea9ebc4 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/8e893b4c303341188f9bb1fe6ea9ebc4 2023-02-18 03:01:10,689 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/8e893b4c303341188f9bb1fe6ea9ebc4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:10,690 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 85da828d2ac9cd27aa9ff19e83b84354 in 835ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,690 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:10,691 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,691 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,691 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/f1fe03d9e8b747d4ad078a948a0fa5fa] hfiles 2023-02-18 03:01:10,691 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/f1fe03d9e8b747d4ad078a948a0fa5fa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,691 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/8e893b4c303341188f9bb1fe6ea9ebc4] hfiles 2023-02-18 03:01:10,691 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/8e893b4c303341188f9bb1fe6ea9ebc4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,707 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. completed. 2023-02-18 03:01:10,707 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:10,707 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:10,707 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 03:01:10,707 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. started... 2023-02-18 03:01:10,707 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:10,708 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,708 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,708 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:10,708 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:10,732 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f2/0d2349da445842b8916ec18c36ae21e1 2023-02-18 03:01:10,736 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f2/a9b053836cf047f792f87d0520e97354 2023-02-18 03:01:10,740 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f1/09ab55b867504245b97649b07a915827 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/09ab55b867504245b97649b07a915827 2023-02-18 03:01:10,744 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f1/22ddfc01752e450889b55c847984ae95 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/22ddfc01752e450889b55c847984ae95 2023-02-18 03:01:10,747 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/09ab55b867504245b97649b07a915827, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,748 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f2/0d2349da445842b8916ec18c36ae21e1 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/0d2349da445842b8916ec18c36ae21e1 2023-02-18 03:01:10,751 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. completed. 2023-02-18 03:01:10,751 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:10,751 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 03:01:10,754 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/22ddfc01752e450889b55c847984ae95, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,755 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f2/a9b053836cf047f792f87d0520e97354 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/a9b053836cf047f792f87d0520e97354 2023-02-18 03:01:10,762 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. completed. 2023-02-18 03:01:10,762 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/0d2349da445842b8916ec18c36ae21e1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,762 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:10,762 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 03:01:10,764 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for efa3b3f5ef9565879657cc72b494750f in 150ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:10,764 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/a9b053836cf047f792f87d0520e97354, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/09ab55b867504245b97649b07a915827] hfiles 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/09ab55b867504245b97649b07a915827 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/0d2349da445842b8916ec18c36ae21e1] hfiles 2023-02-18 03:01:10,764 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/0d2349da445842b8916ec18c36ae21e1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,765 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 03353b3c1856686327ea5f91d22a38e8 in 148ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/22ddfc01752e450889b55c847984ae95] hfiles 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/22ddfc01752e450889b55c847984ae95 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/a9b053836cf047f792f87d0520e97354] hfiles 2023-02-18 03:01:10,765 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/a9b053836cf047f792f87d0520e97354 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,791 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. completed. 2023-02-18 03:01:10,791 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:10,791 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 03:01:10,793 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. completed. 2023-02-18 03:01:10,793 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,39255,1676689267238' in zk 2023-02-18 03:01:10,793 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. completed. 2023-02-18 03:01:10,793 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,793 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-18 03:01:10,794 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase20.apache.org,35525,1676689267198' in zk 2023-02-18 03:01:10,794 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,794 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-18 03:01:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:10,795 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:10,795 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-18 03:01:10,796 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,796 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-18 03:01:10,796 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:10,796 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-18 03:01:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:10,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,39255,1676689267238': 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39255,1676689267238' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase20.apache.org,35525,1676689267198': 2023-02-18 03:01:10,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35525,1676689267198' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 03:01:10,803 INFO [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-18 03:01:10,803 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:10,803 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:10,803 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,803 INFO [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:01:10,807 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:10,807 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:10,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:10,807 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:10,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:10,808 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,809 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:10,809 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:10,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:10,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,814 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,814 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:10,815 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,815 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:10,816 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,816 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:10,816 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,816 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:10,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:10,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:10,868 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:10,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:10,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:10,870 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-18 03:01:11,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-18 03:01:11,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:11,298 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:11,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676689269759Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676689270814 (+1055 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676689270815 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676689270828 (+13 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676689270839 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676689271297 (+458 ms) 2023-02-18 03:01:11,299 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:01:11,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.5390 sec 2023-02-18 03:01:11,870 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:11,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:11,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:11,872 INFO [Listener at localhost.localdomain/46707] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:11,876 INFO [Listener at localhost.localdomain/46707] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:11,884 INFO [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:11,930 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39255] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:11,933 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,015 INFO [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:12,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:12,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 03:01:12,031 INFO [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 03:01:12,031 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:12,032 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 03:01:12,032 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 03:01:12,034 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,034 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,035 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:12,035 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:12,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:12,036 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,036 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,036 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,037 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,037 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 03:01:12,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 03:01:12,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 03:01:12,043 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 03:01:12,043 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:12,044 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 03:01:12,044 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 03:01:12,044 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:12,044 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,044 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. started... 2023-02-18 03:01:12,045 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 85da828d2ac9cd27aa9ff19e83b84354 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 03:01:12,046 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 03:01:12,046 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,046 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. started... 2023-02-18 03:01:12,046 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e4822485b4615bcd402b16297c6bfd40 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:12,046 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 03:01:12,046 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:12,046 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,047 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. started... 2023-02-18 03:01:12,047 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 36f7080bca7b4513f43ddcc675d32ac2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 03:01:12,047 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,048 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. started... 2023-02-18 03:01:12,048 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,048 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 76b154ebf4a37945dfa5aa34d575dcb6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:12,048 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. started... 2023-02-18 03:01:12,048 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ded38d4918dc3b545c687aa0624389dd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:12,051 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 03:01:12,051 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,053 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. started... 2023-02-18 03:01:12,053 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:12,053 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,053 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,053 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. started... 2023-02-18 03:01:12,053 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2b9b0d8d2f16292944eabf0ce19c83c5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:12,051 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:12,055 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 03:01:12,119 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f1/69d94d9c6d994a258a42a1b03311c4c6 2023-02-18 03:01:12,119 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f1/fbed004083cd4448b5305c330cc54b48 2023-02-18 03:01:12,135 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f1/72e9484c28f44af09cf7b7a07aca8305 2023-02-18 03:01:12,139 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f1/0f9da3c0281441c08bf467c81f6c18ac 2023-02-18 03:01:12,167 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f1/493d3aa5973c4ce5b63266ac296b56bb 2023-02-18 03:01:12,191 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f1/457d4302e0304646b09951558ac5f231 2023-02-18 03:01:12,214 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f2/88d43178acc94bbf98ef55ba69155189 2023-02-18 03:01:12,215 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f2/a212e58bca2a4ca4b0ebcd4bc678c167 2023-02-18 03:01:12,228 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f1/fbed004083cd4448b5305c330cc54b48 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/fbed004083cd4448b5305c330cc54b48 2023-02-18 03:01:12,229 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f1/69d94d9c6d994a258a42a1b03311c4c6 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/69d94d9c6d994a258a42a1b03311c4c6 2023-02-18 03:01:12,234 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/fbed004083cd4448b5305c330cc54b48, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,234 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/69d94d9c6d994a258a42a1b03311c4c6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,235 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/.tmp/f2/a212e58bca2a4ca4b0ebcd4bc678c167 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/a212e58bca2a4ca4b0ebcd4bc678c167 2023-02-18 03:01:12,236 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/.tmp/f2/88d43178acc94bbf98ef55ba69155189 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/88d43178acc94bbf98ef55ba69155189 2023-02-18 03:01:12,238 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f2/1dab0ac653444ed48a14b078e8edf962 2023-02-18 03:01:12,243 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/a212e58bca2a4ca4b0ebcd4bc678c167, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,243 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f2/d972760a5c844c5d900efdb74e6cb4b5 2023-02-18 03:01:12,243 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f2/b8de3705fdf04a24961d3cbcf3ba5a2a 2023-02-18 03:01:12,244 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/88d43178acc94bbf98ef55ba69155189, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,244 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e4822485b4615bcd402b16297c6bfd40 in 198ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,244 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:12,244 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,244 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,244 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 03:01:12,244 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. started... 2023-02-18 03:01:12,245 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ded38d4918dc3b545c687aa0624389dd in 197ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,245 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 03353b3c1856686327ea5f91d22a38e8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:12,245 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:12,245 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,245 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:12,245 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. started... 2023-02-18 03:01:12,245 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing efa3b3f5ef9565879657cc72b494750f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:12,245 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 03:01:12,253 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f1/0f9da3c0281441c08bf467c81f6c18ac as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/0f9da3c0281441c08bf467c81f6c18ac 2023-02-18 03:01:12,255 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f2/522b9d38cb754646911d719255a251ea 2023-02-18 03:01:12,259 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f1/72e9484c28f44af09cf7b7a07aca8305 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/72e9484c28f44af09cf7b7a07aca8305 2023-02-18 03:01:12,260 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f1/493d3aa5973c4ce5b63266ac296b56bb as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/493d3aa5973c4ce5b63266ac296b56bb 2023-02-18 03:01:12,268 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/72e9484c28f44af09cf7b7a07aca8305, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,269 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f1/457d4302e0304646b09951558ac5f231 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/457d4302e0304646b09951558ac5f231 2023-02-18 03:01:12,270 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/.tmp/f2/b8de3705fdf04a24961d3cbcf3ba5a2a as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/b8de3705fdf04a24961d3cbcf3ba5a2a 2023-02-18 03:01:12,276 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/0f9da3c0281441c08bf467c81f6c18ac, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:12,277 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/457d4302e0304646b09951558ac5f231, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,278 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/.tmp/f2/1dab0ac653444ed48a14b078e8edf962 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/1dab0ac653444ed48a14b078e8edf962 2023-02-18 03:01:12,279 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/.tmp/f2/522b9d38cb754646911d719255a251ea as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/522b9d38cb754646911d719255a251ea 2023-02-18 03:01:12,281 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/b8de3705fdf04a24961d3cbcf3ba5a2a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,282 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 76b154ebf4a37945dfa5aa34d575dcb6 in 234ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,282 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:12,282 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,282 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 03:01:12,294 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/493d3aa5973c4ce5b63266ac296b56bb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:12,296 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/.tmp/f2/d972760a5c844c5d900efdb74e6cb4b5 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/d972760a5c844c5d900efdb74e6cb4b5 2023-02-18 03:01:12,296 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/1dab0ac653444ed48a14b078e8edf962, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:12,296 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/522b9d38cb754646911d719255a251ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,298 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f1/f50edc1bbe1c490d996643e5d7bd33a4 2023-02-18 03:01:12,298 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2b9b0d8d2f16292944eabf0ce19c83c5 in 245ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,298 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 85da828d2ac9cd27aa9ff19e83b84354 in 253ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,298 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 03:01:12,298 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. started... 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:12,298 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,299 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 03:01:12,302 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/d972760a5c844c5d900efdb74e6cb4b5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:12,303 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 36f7080bca7b4513f43ddcc675d32ac2 in 256ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,303 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:12,303 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,303 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 03:01:12,316 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f2/11c32880250c4a509d63377e92ec176e 2023-02-18 03:01:12,321 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f1/f50edc1bbe1c490d996643e5d7bd33a4 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/f50edc1bbe1c490d996643e5d7bd33a4 2023-02-18 03:01:12,327 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/f50edc1bbe1c490d996643e5d7bd33a4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,328 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/.tmp/f2/11c32880250c4a509d63377e92ec176e as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/11c32880250c4a509d63377e92ec176e 2023-02-18 03:01:12,332 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/11c32880250c4a509d63377e92ec176e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,333 INFO [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for efa3b3f5ef9565879657cc72b494750f in 88ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,333 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:12,333 DEBUG [rs(jenkins-hbase20.apache.org,39255,1676689267238)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:12,333 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 03:01:12,333 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 03:01:12,333 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,334 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 03:01:12,334 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39255,1676689267238' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 03:01:12,394 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,394 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:12,394 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,394 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39255,1676689267238' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 03:01:12,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@289eb0c[Count = 1] remaining members to acquire global barrier 2023-02-18 03:01:12,696 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f1/96832c6c1b3149e3ae8d6129c377e546 2023-02-18 03:01:12,715 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f2/fe841575c96641b29930abb82f1e3aad 2023-02-18 03:01:12,720 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f1/96832c6c1b3149e3ae8d6129c377e546 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/96832c6c1b3149e3ae8d6129c377e546 2023-02-18 03:01:12,725 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/96832c6c1b3149e3ae8d6129c377e546, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,725 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/.tmp/f2/fe841575c96641b29930abb82f1e3aad as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/fe841575c96641b29930abb82f1e3aad 2023-02-18 03:01:12,731 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/fe841575c96641b29930abb82f1e3aad, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:12,732 INFO [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 03353b3c1856686327ea5f91d22a38e8 in 487ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:12,732 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:12,732 DEBUG [rs(jenkins-hbase20.apache.org,35525,1676689267198)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,732 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 03:01:12,732 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 03:01:12,732 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,732 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 03:01:12,732 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35525,1676689267198' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 03:01:12,733 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,733 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:12,734 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,734 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:12,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35525,1676689267198' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 03:01:12,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@289eb0c[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:12,736 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 03:01:12,736 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,737 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,737 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 03:01:12,738 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 03:01:12,737 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 03:01:12,738 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 03:01:12,738 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,39255,1676689267238' in zk 2023-02-18 03:01:12,738 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,35525,1676689267198' in zk 2023-02-18 03:01:12,738 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,738 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 03:01:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 03:01:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,39255,1676689267238' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 03:01:12,740 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,741 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:12,741 DEBUG [member: 'jenkins-hbase20.apache.org,35525,1676689267198' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 03:01:12,741 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:12,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:12,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,39255,1676689267238': 2023-02-18 03:01:12,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39255,1676689267238' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-18 03:01:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:12,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:12,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:12,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,35525,1676689267198': 2023-02-18 03:01:12,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35525,1676689267198' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 03:01:12,748 INFO [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 03:01:12,748 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:12,748 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:12,749 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 03:01:12,749 INFO [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:12,749 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,749 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,749 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:12,750 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:12,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:12,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:12,750 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,750 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:12,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,751 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:12,752 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:12,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,753 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:12,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:12,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:12,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:12,754 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 03:01:12,754 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:12,754 DEBUG [(jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:12,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:12,754 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:12,755 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:12,755 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,755 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:12,755 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:12,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:12,755 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:12,755 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:12,855 DEBUG [Listener at localhost.localdomain/46707] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:12,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40981] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:12,860 INFO [Listener at localhost.localdomain/46707] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:12,860 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x531b01eb to 127.0.0.1:61613 2023-02-18 03:01:12,861 DEBUG [Listener at localhost.localdomain/46707] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:12,861 DEBUG [Listener at localhost.localdomain/46707] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:12,861 DEBUG [Listener at localhost.localdomain/46707] util.JVMClusterUtil(257): Found active master hash=301068630, stopped=false 2023-02-18 03:01:12,862 INFO [Listener at localhost.localdomain/46707] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:12,863 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:12,863 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:12,863 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:12,863 INFO [Listener at localhost.localdomain/46707] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:12,863 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:12,864 DEBUG [Listener at localhost.localdomain/46707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d556fbe to 127.0.0.1:61613 2023-02-18 03:01:12,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:12,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:12,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:12,865 DEBUG [Listener at localhost.localdomain/46707] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:12,865 INFO [Listener at localhost.localdomain/46707] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35525,1676689267198' ***** 2023-02-18 03:01:12,865 INFO [Listener at localhost.localdomain/46707] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:12,865 INFO [Listener at localhost.localdomain/46707] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39255,1676689267238' ***** 2023-02-18 03:01:12,865 INFO [Listener at localhost.localdomain/46707] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:12,866 INFO [RS:0;jenkins-hbase20:35525] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:12,866 INFO [RS:1;jenkins-hbase20:39255] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:12,866 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:12,866 INFO [RS:0;jenkins-hbase20:35525] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:12,866 INFO [RS:1;jenkins-hbase20:39255] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:12,866 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:12,867 INFO [RS:1;jenkins-hbase20:39255] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:12,867 INFO [RS:0;jenkins-hbase20:35525] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:12,868 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(3304): Received CLOSE for 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:12,868 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(3304): Received CLOSE for 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:12,868 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(3304): Received CLOSE for f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:12,868 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(3304): Received CLOSE for ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:12,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 76b154ebf4a37945dfa5aa34d575dcb6, disabling compactions & flushes 2023-02-18 03:01:12,868 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(3304): Received CLOSE for e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:12,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,868 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(3304): Received CLOSE for 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:12,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 85da828d2ac9cd27aa9ff19e83b84354, disabling compactions & flushes 2023-02-18 03:01:12,868 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(3304): Received CLOSE for 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:12,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,869 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(3304): Received CLOSE for 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:12,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,869 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(3304): Received CLOSE for 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:12,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,869 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(3304): Received CLOSE for 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:12,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. after waiting 0 ms 2023-02-18 03:01:12,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,869 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:12,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. after waiting 0 ms 2023-02-18 03:01:12,869 DEBUG [RS:0;jenkins-hbase20:35525] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f57f8a0 to 127.0.0.1:61613 2023-02-18 03:01:12,869 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(3304): Received CLOSE for efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:12,869 DEBUG [RS:0;jenkins-hbase20:35525] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:12,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,870 INFO [RS:0;jenkins-hbase20:35525] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:12,870 INFO [RS:0;jenkins-hbase20:35525] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:12,870 INFO [RS:0;jenkins-hbase20:35525] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:12,870 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:12,870 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:12,870 DEBUG [RS:1;jenkins-hbase20:39255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57ccfa55 to 127.0.0.1:61613 2023-02-18 03:01:12,870 DEBUG [RS:1;jenkins-hbase20:39255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:12,870 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-18 03:01:12,870 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1479): Online Regions={76b154ebf4a37945dfa5aa34d575dcb6=testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6., f3b307113cc3cccd94f20bdc297dcea0=hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0., ded38d4918dc3b545c687aa0624389dd=testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd., 3398a6bf7d3ad44093adaa9d19e1caba=testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba., 2b9b0d8d2f16292944eabf0ce19c83c5=testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5., efa3b3f5ef9565879657cc72b494750f=testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.} 2023-02-18 03:01:12,870 DEBUG [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1505): Waiting on 2b9b0d8d2f16292944eabf0ce19c83c5, 3398a6bf7d3ad44093adaa9d19e1caba, 76b154ebf4a37945dfa5aa34d575dcb6, ded38d4918dc3b545c687aa0624389dd, efa3b3f5ef9565879657cc72b494750f, f3b307113cc3cccd94f20bdc297dcea0 2023-02-18 03:01:12,871 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-18 03:01:12,871 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1479): Online Regions={85da828d2ac9cd27aa9ff19e83b84354=testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354., 1588230740=hbase:meta,,1.1588230740, e4822485b4615bcd402b16297c6bfd40=testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40., 36f7080bca7b4513f43ddcc675d32ac2=testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2., 03353b3c1856686327ea5f91d22a38e8=testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8., 15983e76d89189b89024beb1329c1cf5=testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.} 2023-02-18 03:01:12,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:12,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:12,871 DEBUG [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1505): Waiting on 03353b3c1856686327ea5f91d22a38e8, 1588230740, 15983e76d89189b89024beb1329c1cf5, 36f7080bca7b4513f43ddcc675d32ac2, 85da828d2ac9cd27aa9ff19e83b84354, e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:12,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:12,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:12,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:12,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.97 KB heapSize=23.05 KB 2023-02-18 03:01:12,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:12,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:12,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f3b307113cc3cccd94f20bdc297dcea0, disabling compactions & flushes 2023-02-18 03:01:12,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:12,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:12,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. after waiting 0 ms 2023-02-18 03:01:12,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:12,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing f3b307113cc3cccd94f20bdc297dcea0 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:12,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.78 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/.tmp/info/7a1e6b08b8234acca7c2cae20c8a323e 2023-02-18 03:01:12,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:12,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:12,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing e4822485b4615bcd402b16297c6bfd40, disabling compactions & flushes 2023-02-18 03:01:12,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. after waiting 0 ms 2023-02-18 03:01:12,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,903 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:12,903 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:12,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/.tmp/info/6987af4e8ad041bdb206af5694046508 2023-02-18 03:01:12,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:12,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:12,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 36f7080bca7b4513f43ddcc675d32ac2, disabling compactions & flushes 2023-02-18 03:01:12,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. after waiting 0 ms 2023-02-18 03:01:12,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/.tmp/table/d8c4cbc0326f404ca15c554ae1e156d6 2023-02-18 03:01:12,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:12,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:12,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 03353b3c1856686327ea5f91d22a38e8, disabling compactions & flushes 2023-02-18 03:01:12,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. after waiting 0 ms 2023-02-18 03:01:12,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/.tmp/info/6987af4e8ad041bdb206af5694046508 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/info/6987af4e8ad041bdb206af5694046508 2023-02-18 03:01:12,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,932 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/.tmp/info/7a1e6b08b8234acca7c2cae20c8a323e as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/info/7a1e6b08b8234acca7c2cae20c8a323e 2023-02-18 03:01:12,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:12,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:12,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/info/6987af4e8ad041bdb206af5694046508, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:12,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 15983e76d89189b89024beb1329c1cf5, disabling compactions & flushes 2023-02-18 03:01:12,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. after waiting 0 ms 2023-02-18 03:01:12,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 03:01:12,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f3b307113cc3cccd94f20bdc297dcea0 in 53ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:12,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-18 03:01:12,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/info/7a1e6b08b8234acca7c2cae20c8a323e, entries=110, sequenceid=32, filesize=18.7 K 2023-02-18 03:01:12,946 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/.tmp/table/d8c4cbc0326f404ca15c554ae1e156d6 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/table/d8c4cbc0326f404ca15c554ae1e156d6 2023-02-18 03:01:12,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:12,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:12,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/namespace/f3b307113cc3cccd94f20bdc297dcea0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:12,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f3b307113cc3cccd94f20bdc297dcea0: 2023-02-18 03:01:12,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/table/d8c4cbc0326f404ca15c554ae1e156d6, entries=4, sequenceid=32, filesize=4.8 K 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689267848.f3b307113cc3cccd94f20bdc297dcea0. 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing ded38d4918dc3b545c687aa0624389dd, disabling compactions & flushes 2023-02-18 03:01:12,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. after waiting 0 ms 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.97 KB/14302, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 82ms, sequenceid=32, compaction requested=false 2023-02-18 03:01:12,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-18 03:01:12,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-18 03:01:12,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 3398a6bf7d3ad44093adaa9d19e1caba, disabling compactions & flushes 2023-02-18 03:01:12,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. after waiting 0 ms 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:12,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:12,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:12,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:12,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 03:01:12,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:12,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:12,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 2b9b0d8d2f16292944eabf0ce19c83c5, disabling compactions & flushes 2023-02-18 03:01:12,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. after waiting 0 ms 2023-02-18 03:01:12,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:12,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing efa3b3f5ef9565879657cc72b494750f, disabling compactions & flushes 2023-02-18 03:01:12,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. after waiting 0 ms 2023-02-18 03:01:12,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:12,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:12,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:12,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:12,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:13,070 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39255,1676689267238; all regions closed. 2023-02-18 03:01:13,071 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35525,1676689267198; all regions closed. 2023-02-18 03:01:13,074 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/WALs/jenkins-hbase20.apache.org,35525,1676689267198/jenkins-hbase20.apache.org%2C35525%2C1676689267198.meta.1676689267787.meta not finished, retry = 0 2023-02-18 03:01:13,076 DEBUG [RS:1;jenkins-hbase20:39255] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/oldWALs 2023-02-18 03:01:13,076 INFO [RS:1;jenkins-hbase20:39255] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39255%2C1676689267238:(num 1676689268576) 2023-02-18 03:01:13,076 DEBUG [RS:1;jenkins-hbase20:39255] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:13,076 INFO [RS:1;jenkins-hbase20:39255] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:13,076 INFO [RS:1;jenkins-hbase20:39255] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:13,076 INFO [RS:1;jenkins-hbase20:39255] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:13,076 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:13,076 INFO [RS:1;jenkins-hbase20:39255] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:13,076 INFO [RS:1;jenkins-hbase20:39255] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:13,077 INFO [RS:1;jenkins-hbase20:39255] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39255 2023-02-18 03:01:13,078 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:13,078 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,39255,1676689267238 2023-02-18 03:01:13,079 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:13,079 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4808b719 rejected from java.util.concurrent.ThreadPoolExecutor@4c373ac0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,078 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:13,079 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:13,079 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35cb2f65 rejected from java.util.concurrent.ThreadPoolExecutor@4c373ac0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,080 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,39255,1676689267238] 2023-02-18 03:01:13,080 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,39255,1676689267238; numProcessing=1 2023-02-18 03:01:13,080 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,39255,1676689267238 already deleted, retry=false 2023-02-18 03:01:13,080 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,39255,1676689267238 expired; onlineServers=1 2023-02-18 03:01:13,177 DEBUG [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/oldWALs 2023-02-18 03:01:13,177 INFO [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35525%2C1676689267198.meta:.meta(num 1676689267787) 2023-02-18 03:01:13,180 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:13,180 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d623a4e rejected from java.util.concurrent.ThreadPoolExecutor@4c373ac0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,180 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:39255-0x10173879b440002, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:13,180 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@546e82c rejected from java.util.concurrent.ThreadPoolExecutor@4c373ac0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,180 INFO [RS:1;jenkins-hbase20:39255] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39255,1676689267238; zookeeper connection closed. 2023-02-18 03:01:13,181 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22666632] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22666632 2023-02-18 03:01:13,183 DEBUG [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/oldWALs 2023-02-18 03:01:13,184 INFO [RS:0;jenkins-hbase20:35525] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35525%2C1676689267198:(num 1676689268583) 2023-02-18 03:01:13,184 DEBUG [RS:0;jenkins-hbase20:35525] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:13,184 INFO [RS:0;jenkins-hbase20:35525] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:13,184 INFO [RS:0;jenkins-hbase20:35525] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:13,184 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:13,185 INFO [RS:0;jenkins-hbase20:35525] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35525 2023-02-18 03:01:13,187 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35525,1676689267198 2023-02-18 03:01:13,187 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@764e6eac rejected from java.util.concurrent.ThreadPoolExecutor@7271e4bd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,188 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:13,188 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35525,1676689267198] 2023-02-18 03:01:13,188 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35525,1676689267198; numProcessing=2 2023-02-18 03:01:13,189 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35525,1676689267198 already deleted, retry=false 2023-02-18 03:01:13,189 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,35525,1676689267198 expired; onlineServers=0 2023-02-18 03:01:13,189 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,40981,1676689267123' ***** 2023-02-18 03:01:13,189 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:13,190 DEBUG [M:0;jenkins-hbase20:40981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50ccfb6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:13,190 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,40981,1676689267123 2023-02-18 03:01:13,190 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,40981,1676689267123; all regions closed. 2023-02-18 03:01:13,190 DEBUG [M:0;jenkins-hbase20:40981] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:13,190 DEBUG [M:0;jenkins-hbase20:40981] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:13,190 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:13,190 DEBUG [M:0;jenkins-hbase20:40981] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:13,190 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689267426] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689267426,5,FailOnTimeoutGroup] 2023-02-18 03:01:13,190 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689267426] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689267426,5,FailOnTimeoutGroup] 2023-02-18 03:01:13,191 INFO [M:0;jenkins-hbase20:40981] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:13,191 INFO [M:0;jenkins-hbase20:40981] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:13,192 INFO [M:0;jenkins-hbase20:40981] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:13,192 DEBUG [M:0;jenkins-hbase20:40981] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:13,192 INFO [M:0;jenkins-hbase20:40981] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:13,193 ERROR [M:0;jenkins-hbase20:40981] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 03:01:13,193 INFO [M:0;jenkins-hbase20:40981] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:13,193 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:13,193 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:13,193 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:13,193 DEBUG [M:0;jenkins-hbase20:40981] zookeeper.ZKUtil(398): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:13,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:13,193 WARN [M:0;jenkins-hbase20:40981] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:13,193 INFO [M:0;jenkins-hbase20:40981] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:13,194 INFO [M:0;jenkins-hbase20:40981] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:13,194 DEBUG [M:0;jenkins-hbase20:40981] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:13,194 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:13,194 DEBUG [M:0;jenkins-hbase20:40981] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:13,194 DEBUG [M:0;jenkins-hbase20:40981] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:13,194 DEBUG [M:0;jenkins-hbase20:40981] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:13,195 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=101.13 KB heapSize=120.84 KB 2023-02-18 03:01:13,206 INFO [M:0;jenkins-hbase20:40981] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=101.13 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fe4658c2bf754b4692de40b1ba419000 2023-02-18 03:01:13,212 DEBUG [M:0;jenkins-hbase20:40981] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fe4658c2bf754b4692de40b1ba419000 as hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fe4658c2bf754b4692de40b1ba419000 2023-02-18 03:01:13,218 INFO [M:0;jenkins-hbase20:40981] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33221/user/jenkins/test-data/470793d2-cbd3-48df-60a3-e8db0f523d9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fe4658c2bf754b4692de40b1ba419000, entries=31, sequenceid=218, filesize=9.0 K 2023-02-18 03:01:13,219 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegion(2947): Finished flush of dataSize ~101.13 KB/103559, heapSize ~120.82 KB/123720, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=218, compaction requested=false 2023-02-18 03:01:13,222 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:13,222 DEBUG [M:0;jenkins-hbase20:40981] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:13,225 INFO [M:0;jenkins-hbase20:40981] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:13,225 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:13,226 INFO [M:0;jenkins-hbase20:40981] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40981 2023-02-18 03:01:13,229 DEBUG [M:0;jenkins-hbase20:40981] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,40981,1676689267123 already deleted, retry=false 2023-02-18 03:01:13,288 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:13,288 INFO [RS:0;jenkins-hbase20:35525] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35525,1676689267198; zookeeper connection closed. 2023-02-18 03:01:13,289 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3307253 rejected from java.util.concurrent.ThreadPoolExecutor@7271e4bd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,289 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2fb397c0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2fb397c0 2023-02-18 03:01:13,289 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x10173879b440001, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:13,289 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ba71fe7 rejected from java.util.concurrent.ThreadPoolExecutor@7271e4bd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,289 INFO [Listener at localhost.localdomain/46707] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:13,389 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:13,389 INFO [M:0;jenkins-hbase20:40981] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,40981,1676689267123; zookeeper connection closed. 2023-02-18 03:01:13,389 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72126192 rejected from java.util.concurrent.ThreadPoolExecutor@762deb08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,390 DEBUG [Listener at localhost.localdomain/46707-EventThread] zookeeper.ZKWatcher(600): master:40981-0x10173879b440000, quorum=127.0.0.1:61613, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:13,390 ERROR [Listener at localhost.localdomain/46707-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63a9fbf4 rejected from java.util.concurrent.ThreadPoolExecutor@762deb08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:13,466 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop-4184858473863913548.jar 2023-02-18 03:01:13,470 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676689269726 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:13,470 DEBUG [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(239): region to add: efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=85da828d2ac9cd27aa9ff19e83b84354 as 85da828d2ac9cd27aa9ff19e83b84354 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=76b154ebf4a37945dfa5aa34d575dcb6 as 76b154ebf4a37945dfa5aa34d575dcb6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=e4822485b4615bcd402b16297c6bfd40 as e4822485b4615bcd402b16297c6bfd40 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=36f7080bca7b4513f43ddcc675d32ac2 as 36f7080bca7b4513f43ddcc675d32ac2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,471 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=ded38d4918dc3b545c687aa0624389dd as ded38d4918dc3b545c687aa0624389dd in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,472 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=3398a6bf7d3ad44093adaa9d19e1caba as 3398a6bf7d3ad44093adaa9d19e1caba in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,472 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=03353b3c1856686327ea5f91d22a38e8 as 03353b3c1856686327ea5f91d22a38e8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,472 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=2b9b0d8d2f16292944eabf0ce19c83c5 as 2b9b0d8d2f16292944eabf0ce19c83c5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,472 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=15983e76d89189b89024beb1329c1cf5 as 15983e76d89189b89024beb1329c1cf5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,472 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(585): clone region=efa3b3f5ef9565879657cc72b494750f as efa3b3f5ef9565879657cc72b494750f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-18 03:01:13,473 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ded38d4918dc3b545c687aa0624389dd, NAME => 'testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,473 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3398a6bf7d3ad44093adaa9d19e1caba, NAME => 'testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,473 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 85da828d2ac9cd27aa9ff19e83b84354, NAME => 'testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,473 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 36f7080bca7b4513f43ddcc675d32ac2, NAME => 'testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,473 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e4822485b4615bcd402b16297c6bfd40, NAME => 'testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,474 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 76b154ebf4a37945dfa5aa34d575dcb6, NAME => 'testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,474 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2b9b0d8d2f16292944eabf0ce19c83c5, NAME => 'testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,474 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 03353b3c1856686327ea5f91d22a38e8, NAME => 'testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,488 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,488 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 499e27d352c247dbabe96dd75b8400b8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,491 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5d25514e842c44bb892bf70711609f36 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3398a6bf7d3ad44093adaa9d19e1caba, disabling compactions & flushes 2023-02-18 03:01:13,493 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:13,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:13,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. after waiting 0 ms 2023-02-18 03:01:13,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:13,493 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:13,493 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:13,494 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 15983e76d89189b89024beb1329c1cf5, NAME => 'testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,494 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,494 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,494 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 89fbc891ced546f8a9291eb391c1fa33 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,494 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 08eaff8e373a442189988f222f4b5dd6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,494 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,494 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a30473dbf8994b4d9a2c9cb85e9349a7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,495 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ded38d4918dc3b545c687aa0624389dd, disabling compactions & flushes 2023-02-18 03:01:13,495 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:13,495 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:13,495 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. after waiting 0 ms 2023-02-18 03:01:13,495 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:13,495 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:13,495 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:13,495 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => efa3b3f5ef9565879657cc72b494750f, NAME => 'testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,496 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,496 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 22ddfc01752e450889b55c847984ae95 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,496 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,496 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 95b474876e4e4a0a9807adef799d7b52 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,496 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,496 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1fe03d9e8b747d4ad078a948a0fa5fa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,498 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4fa93df656b4db5a115f804d17eb284 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,499 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9b053836cf047f792f87d0520e97354 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,500 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d75f0030e5a84cd0af11ce61accef65a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,500 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02b053c529fb4fd8ab050473cf2585d7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,502 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8e893b4c303341188f9bb1fe6ea9ebc4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,502 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 76b154ebf4a37945dfa5aa34d575dcb6, disabling compactions & flushes 2023-02-18 03:01:13,503 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c438eaecd6f4ab5aaef41bc07be9a53 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,503 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:13,502 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2b9b0d8d2f16292944eabf0ce19c83c5, disabling compactions & flushes 2023-02-18 03:01:13,502 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 36f7080bca7b4513f43ddcc675d32ac2, disabling compactions & flushes 2023-02-18 03:01:13,503 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. after waiting 0 ms 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,503 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 03353b3c1856686327ea5f91d22a38e8, disabling compactions & flushes 2023-02-18 03:01:13,503 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,503 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. after waiting 0 ms 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. after waiting 0 ms 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,504 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:13,503 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. after waiting 0 ms 2023-02-18 03:01:13,504 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:13,504 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 85da828d2ac9cd27aa9ff19e83b84354, disabling compactions & flushes 2023-02-18 03:01:13,504 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:13,504 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. after waiting 0 ms 2023-02-18 03:01:13,505 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:13,505 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:13,505 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:13,505 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e4822485b4615bcd402b16297c6bfd40, disabling compactions & flushes 2023-02-18 03:01:13,505 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:13,505 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:13,506 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. after waiting 0 ms 2023-02-18 03:01:13,506 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:13,506 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:13,506 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:13,506 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,506 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 09ab55b867504245b97649b07a915827 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,507 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,507 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 15983e76d89189b89024beb1329c1cf5, disabling compactions & flushes 2023-02-18 03:01:13,507 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,507 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,508 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. after waiting 0 ms 2023-02-18 03:01:13,508 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,508 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,508 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:13,510 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0d2349da445842b8916ec18c36ae21e1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-18 03:01:13,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing efa3b3f5ef9565879657cc72b494750f, disabling compactions & flushes 2023-02-18 03:01:13,512 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:13,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:13,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. after waiting 0 ms 2023-02-18 03:01:13,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:13,512 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:13,512 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:13,513 INFO [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676689269726 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:13,513 DEBUG [Listener at localhost.localdomain/46707] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,513 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6 2023-02-18 03:01:13,513 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:13,514 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:13,514 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 03:01:13,515 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------03353b3c1856686327ea5f91d22a38e8/ 2023-02-18 03:01:13,515 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,515 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,515 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=03353b3c1856686327ea5f91d22a38e8-22ddfc01752e450889b55c847984ae95 2023-02-18 03:01:13,515 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,516 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=03353b3c1856686327ea5f91d22a38e8-a9b053836cf047f792f87d0520e97354 2023-02-18 03:01:13,516 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------15983e76d89189b89024beb1329c1cf5/ 2023-02-18 03:01:13,516 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,516 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------2b9b0d8d2f16292944eabf0ce19c83c5/ 2023-02-18 03:01:13,517 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,517 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,517 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=2b9b0d8d2f16292944eabf0ce19c83c5-08eaff8e373a442189988f222f4b5dd6 2023-02-18 03:01:13,517 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,518 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=2b9b0d8d2f16292944eabf0ce19c83c5-e4fa93df656b4db5a115f804d17eb284 2023-02-18 03:01:13,519 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------3398a6bf7d3ad44093adaa9d19e1caba/ 2023-02-18 03:01:13,519 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,519 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------36f7080bca7b4513f43ddcc675d32ac2/ 2023-02-18 03:01:13,520 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,520 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,520 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=36f7080bca7b4513f43ddcc675d32ac2-89fbc891ced546f8a9291eb391c1fa33 2023-02-18 03:01:13,521 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,521 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=36f7080bca7b4513f43ddcc675d32ac2-02b053c529fb4fd8ab050473cf2585d7 2023-02-18 03:01:13,521 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------76b154ebf4a37945dfa5aa34d575dcb6/ 2023-02-18 03:01:13,522 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,522 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,523 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=76b154ebf4a37945dfa5aa34d575dcb6-a30473dbf8994b4d9a2c9cb85e9349a7 2023-02-18 03:01:13,523 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,523 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=76b154ebf4a37945dfa5aa34d575dcb6-d75f0030e5a84cd0af11ce61accef65a 2023-02-18 03:01:13,523 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------85da828d2ac9cd27aa9ff19e83b84354/ 2023-02-18 03:01:13,524 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,524 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,525 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=85da828d2ac9cd27aa9ff19e83b84354-f1fe03d9e8b747d4ad078a948a0fa5fa 2023-02-18 03:01:13,525 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,525 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=85da828d2ac9cd27aa9ff19e83b84354-8e893b4c303341188f9bb1fe6ea9ebc4 2023-02-18 03:01:13,525 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------ded38d4918dc3b545c687aa0624389dd/ 2023-02-18 03:01:13,526 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,526 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,526 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=ded38d4918dc3b545c687aa0624389dd-499e27d352c247dbabe96dd75b8400b8 2023-02-18 03:01:13,526 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,526 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=ded38d4918dc3b545c687aa0624389dd-5d25514e842c44bb892bf70711609f36 2023-02-18 03:01:13,526 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------e4822485b4615bcd402b16297c6bfd40/ 2023-02-18 03:01:13,527 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,527 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,527 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=e4822485b4615bcd402b16297c6bfd40-95b474876e4e4a0a9807adef799d7b52 2023-02-18 03:01:13,528 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,528 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=e4822485b4615bcd402b16297c6bfd40-0c438eaecd6f4ab5aaef41bc07be9a53 2023-02-18 03:01:13,528 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |----------efa3b3f5ef9565879657cc72b494750f/ 2023-02-18 03:01:13,528 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:13,528 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:13,529 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=efa3b3f5ef9565879657cc72b494750f-09ab55b867504245b97649b07a915827 2023-02-18 03:01:13,529 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:13,529 DEBUG [Listener at localhost.localdomain/46707] util.CommonFSUtils(702): |----------------testWithMapReduce=efa3b3f5ef9565879657cc72b494750f-0d2349da445842b8916ec18c36ae21e1 2023-02-18 03:01:13,530 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,530 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,530 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,530 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,531 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,531 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,531 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,587 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop-6271403376106219663.jar 2023-02-18 03:01:13,587 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,588 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,588 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,588 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,589 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,589 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,589 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 03:01:13,589 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 03:01:13,590 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 03:01:13,590 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 03:01:13,590 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 03:01:13,591 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 03:01:13,591 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 03:01:13,591 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 03:01:13,591 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 03:01:13,592 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 03:01:13,592 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:13,592 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:13,593 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:13,593 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:13,593 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 03:01:13,648 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop-8444291301807915609.jar 2023-02-18 03:01:13,649 DEBUG [Listener at localhost.localdomain/46707] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 03:01:13,653 WARN [Listener at localhost.localdomain/46707] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 03:01:13,678 INFO [Listener at localhost.localdomain/46707] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 03:01:13,787 WARN [Listener at localhost.localdomain/46707] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/mapreduce.cluster.local.dir/1676689273762/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 03:01:13,787 WARN [Listener at localhost.localdomain/46707] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/mapreduce.cluster.local.dir/1676689273762/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 03:01:13,832 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,832 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:13,833 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:13,834 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:13,835 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1 2023-02-18 03:01:13,836 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b0d8d2f16292944eabf0ce19c83c5 columnFamilyName f1 2023-02-18 03:01:13,840 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f1/testWithMapReduce=2b9b0d8d2f16292944eabf0ce19c83c5-08eaff8e373a442189988f222f4b5dd6 2023-02-18 03:01:13,840 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(310): Store=2b9b0d8d2f16292944eabf0ce19c83c5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,841 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b9b0d8d2f16292944eabf0ce19c83c5 2023-02-18 03:01:13,841 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2 2023-02-18 03:01:13,842 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b9b0d8d2f16292944eabf0ce19c83c5 columnFamilyName f2 2023-02-18 03:01:13,846 DEBUG [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/2b9b0d8d2f16292944eabf0ce19c83c5/f2/testWithMapReduce=2b9b0d8d2f16292944eabf0ce19c83c5-e4fa93df656b4db5a115f804d17eb284 2023-02-18 03:01:13,846 INFO [StoreOpener-2b9b0d8d2f16292944eabf0ce19c83c5-1] regionserver.HStore(310): Store=2b9b0d8d2f16292944eabf0ce19c83c5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:13,846 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2b9b0d8d2f16292944eabf0ce19c83c5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74430125, jitterRate=0.10909529030323029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:13,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:13,866 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2b9b0d8d2f16292944eabf0ce19c83c5, disabling compactions & flushes 2023-02-18 03:01:13,867 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,867 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,867 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. after waiting 0 ms 2023-02-18 03:01:13,867 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,867 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676689268883.2b9b0d8d2f16292944eabf0ce19c83c5. 2023-02-18 03:01:13,867 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2b9b0d8d2f16292944eabf0ce19c83c5: 2023-02-18 03:01:13,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,870 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:13,871 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:13,875 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:13,877 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1 2023-02-18 03:01:13,877 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03353b3c1856686327ea5f91d22a38e8 columnFamilyName f1 2023-02-18 03:01:13,883 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f1/testWithMapReduce=03353b3c1856686327ea5f91d22a38e8-22ddfc01752e450889b55c847984ae95 2023-02-18 03:01:13,883 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(310): Store=03353b3c1856686327ea5f91d22a38e8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,883 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 03353b3c1856686327ea5f91d22a38e8 2023-02-18 03:01:13,885 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2 2023-02-18 03:01:13,885 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03353b3c1856686327ea5f91d22a38e8 columnFamilyName f2 2023-02-18 03:01:13,890 DEBUG [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/03353b3c1856686327ea5f91d22a38e8/f2/testWithMapReduce=03353b3c1856686327ea5f91d22a38e8-a9b053836cf047f792f87d0520e97354 2023-02-18 03:01:13,890 INFO [StoreOpener-03353b3c1856686327ea5f91d22a38e8-1] regionserver.HStore(310): Store=03353b3c1856686327ea5f91d22a38e8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:13,890 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 03353b3c1856686327ea5f91d22a38e8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71267153, jitterRate=0.06196333467960358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:13,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 03353b3c1856686327ea5f91d22a38e8, disabling compactions & flushes 2023-02-18 03:01:13,909 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. after waiting 0 ms 2023-02-18 03:01:13,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,910 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676689268883.03353b3c1856686327ea5f91d22a38e8. 2023-02-18 03:01:13,910 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 03353b3c1856686327ea5f91d22a38e8: 2023-02-18 03:01:13,913 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,913 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:13,914 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:13,916 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:13,917 DEBUG [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/f1 2023-02-18 03:01:13,918 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15983e76d89189b89024beb1329c1cf5 columnFamilyName f1 2023-02-18 03:01:13,918 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(310): Store=15983e76d89189b89024beb1329c1cf5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,918 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15983e76d89189b89024beb1329c1cf5 2023-02-18 03:01:13,919 DEBUG [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/15983e76d89189b89024beb1329c1cf5/f2 2023-02-18 03:01:13,919 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15983e76d89189b89024beb1329c1cf5 columnFamilyName f2 2023-02-18 03:01:13,920 INFO [StoreOpener-15983e76d89189b89024beb1329c1cf5-1] regionserver.HStore(310): Store=15983e76d89189b89024beb1329c1cf5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:13,920 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 15983e76d89189b89024beb1329c1cf5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67887400, jitterRate=0.011601090431213379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:13,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:13,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 15983e76d89189b89024beb1329c1cf5, disabling compactions & flushes 2023-02-18 03:01:13,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. after waiting 0 ms 2023-02-18 03:01:13,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689268883.15983e76d89189b89024beb1329c1cf5. 2023-02-18 03:01:13,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 15983e76d89189b89024beb1329c1cf5: 2023-02-18 03:01:13,931 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,931 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:13,932 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:13,934 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:13,934 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1 2023-02-18 03:01:13,935 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36f7080bca7b4513f43ddcc675d32ac2 columnFamilyName f1 2023-02-18 03:01:13,939 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f1/testWithMapReduce=36f7080bca7b4513f43ddcc675d32ac2-89fbc891ced546f8a9291eb391c1fa33 2023-02-18 03:01:13,939 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(310): Store=36f7080bca7b4513f43ddcc675d32ac2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,939 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36f7080bca7b4513f43ddcc675d32ac2 2023-02-18 03:01:13,940 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2 2023-02-18 03:01:13,941 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36f7080bca7b4513f43ddcc675d32ac2 columnFamilyName f2 2023-02-18 03:01:13,944 DEBUG [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/36f7080bca7b4513f43ddcc675d32ac2/f2/testWithMapReduce=36f7080bca7b4513f43ddcc675d32ac2-02b053c529fb4fd8ab050473cf2585d7 2023-02-18 03:01:13,945 INFO [StoreOpener-36f7080bca7b4513f43ddcc675d32ac2-1] regionserver.HStore(310): Store=36f7080bca7b4513f43ddcc675d32ac2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:13,945 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 36f7080bca7b4513f43ddcc675d32ac2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67761584, jitterRate=0.009726285934448242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:13,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:13,975 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 36f7080bca7b4513f43ddcc675d32ac2, disabling compactions & flushes 2023-02-18 03:01:13,975 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,975 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,975 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. after waiting 0 ms 2023-02-18 03:01:13,975 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,976 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676689268883.36f7080bca7b4513f43ddcc675d32ac2. 2023-02-18 03:01:13,976 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 36f7080bca7b4513f43ddcc675d32ac2: 2023-02-18 03:01:13,979 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:13,979 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:13,982 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:13,984 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:13,985 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1 2023-02-18 03:01:13,985 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efa3b3f5ef9565879657cc72b494750f columnFamilyName f1 2023-02-18 03:01:13,990 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f1/testWithMapReduce=efa3b3f5ef9565879657cc72b494750f-09ab55b867504245b97649b07a915827 2023-02-18 03:01:13,990 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(310): Store=efa3b3f5ef9565879657cc72b494750f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,990 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region efa3b3f5ef9565879657cc72b494750f 2023-02-18 03:01:13,991 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2 2023-02-18 03:01:13,992 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efa3b3f5ef9565879657cc72b494750f columnFamilyName f2 2023-02-18 03:01:13,996 DEBUG [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/efa3b3f5ef9565879657cc72b494750f/f2/testWithMapReduce=efa3b3f5ef9565879657cc72b494750f-0d2349da445842b8916ec18c36ae21e1 2023-02-18 03:01:13,996 INFO [StoreOpener-efa3b3f5ef9565879657cc72b494750f-1] regionserver.HStore(310): Store=efa3b3f5ef9565879657cc72b494750f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:13,996 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:13,997 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened efa3b3f5ef9565879657cc72b494750f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65704222, jitterRate=-0.02093079686164856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:13,997 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:14,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing efa3b3f5ef9565879657cc72b494750f, disabling compactions & flushes 2023-02-18 03:01:14,015 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:14,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:14,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. after waiting 0 ms 2023-02-18 03:01:14,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:14,016 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676689268883.efa3b3f5ef9565879657cc72b494750f. 2023-02-18 03:01:14,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for efa3b3f5ef9565879657cc72b494750f: 2023-02-18 03:01:14,020 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:14,020 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:14,024 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:14,026 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:14,027 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1 2023-02-18 03:01:14,027 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76b154ebf4a37945dfa5aa34d575dcb6 columnFamilyName f1 2023-02-18 03:01:14,031 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f1/testWithMapReduce=76b154ebf4a37945dfa5aa34d575dcb6-a30473dbf8994b4d9a2c9cb85e9349a7 2023-02-18 03:01:14,031 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(310): Store=76b154ebf4a37945dfa5aa34d575dcb6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,031 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76b154ebf4a37945dfa5aa34d575dcb6 2023-02-18 03:01:14,032 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2 2023-02-18 03:01:14,033 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76b154ebf4a37945dfa5aa34d575dcb6 columnFamilyName f2 2023-02-18 03:01:14,037 DEBUG [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/76b154ebf4a37945dfa5aa34d575dcb6/f2/testWithMapReduce=76b154ebf4a37945dfa5aa34d575dcb6-d75f0030e5a84cd0af11ce61accef65a 2023-02-18 03:01:14,037 INFO [StoreOpener-76b154ebf4a37945dfa5aa34d575dcb6-1] regionserver.HStore(310): Store=76b154ebf4a37945dfa5aa34d575dcb6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:14,037 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 76b154ebf4a37945dfa5aa34d575dcb6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73448977, jitterRate=0.09447504580020905}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:14,037 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:14,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 76b154ebf4a37945dfa5aa34d575dcb6, disabling compactions & flushes 2023-02-18 03:01:14,056 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:14,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:14,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. after waiting 0 ms 2023-02-18 03:01:14,056 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:14,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676689268883.76b154ebf4a37945dfa5aa34d575dcb6. 2023-02-18 03:01:14,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 76b154ebf4a37945dfa5aa34d575dcb6: 2023-02-18 03:01:14,059 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:14,059 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:14,060 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:14,062 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:14,063 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1 2023-02-18 03:01:14,063 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded38d4918dc3b545c687aa0624389dd columnFamilyName f1 2023-02-18 03:01:14,068 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f1/testWithMapReduce=ded38d4918dc3b545c687aa0624389dd-499e27d352c247dbabe96dd75b8400b8 2023-02-18 03:01:14,068 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(310): Store=ded38d4918dc3b545c687aa0624389dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,068 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ded38d4918dc3b545c687aa0624389dd 2023-02-18 03:01:14,069 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2 2023-02-18 03:01:14,069 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ded38d4918dc3b545c687aa0624389dd columnFamilyName f2 2023-02-18 03:01:14,073 DEBUG [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/ded38d4918dc3b545c687aa0624389dd/f2/testWithMapReduce=ded38d4918dc3b545c687aa0624389dd-5d25514e842c44bb892bf70711609f36 2023-02-18 03:01:14,073 INFO [StoreOpener-ded38d4918dc3b545c687aa0624389dd-1] regionserver.HStore(310): Store=ded38d4918dc3b545c687aa0624389dd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,073 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:14,074 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ded38d4918dc3b545c687aa0624389dd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65763032, jitterRate=-0.02005445957183838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:14,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:14,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ded38d4918dc3b545c687aa0624389dd, disabling compactions & flushes 2023-02-18 03:01:14,092 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:14,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:14,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. after waiting 0 ms 2023-02-18 03:01:14,092 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:14,093 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676689268883.ded38d4918dc3b545c687aa0624389dd. 2023-02-18 03:01:14,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ded38d4918dc3b545c687aa0624389dd: 2023-02-18 03:01:14,096 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:14,096 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:14,098 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:14,100 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:14,101 DEBUG [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/f1 2023-02-18 03:01:14,102 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3398a6bf7d3ad44093adaa9d19e1caba columnFamilyName f1 2023-02-18 03:01:14,102 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(310): Store=3398a6bf7d3ad44093adaa9d19e1caba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,102 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3398a6bf7d3ad44093adaa9d19e1caba 2023-02-18 03:01:14,104 DEBUG [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/3398a6bf7d3ad44093adaa9d19e1caba/f2 2023-02-18 03:01:14,104 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3398a6bf7d3ad44093adaa9d19e1caba columnFamilyName f2 2023-02-18 03:01:14,105 INFO [StoreOpener-3398a6bf7d3ad44093adaa9d19e1caba-1] regionserver.HStore(310): Store=3398a6bf7d3ad44093adaa9d19e1caba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:14,105 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3398a6bf7d3ad44093adaa9d19e1caba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69201698, jitterRate=0.031185656785964966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:14,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:14,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3398a6bf7d3ad44093adaa9d19e1caba, disabling compactions & flushes 2023-02-18 03:01:14,116 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:14,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:14,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. after waiting 0 ms 2023-02-18 03:01:14,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:14,116 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676689268883.3398a6bf7d3ad44093adaa9d19e1caba. 2023-02-18 03:01:14,116 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3398a6bf7d3ad44093adaa9d19e1caba: 2023-02-18 03:01:14,120 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:14,120 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:14,123 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:14,125 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:14,126 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1 2023-02-18 03:01:14,127 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85da828d2ac9cd27aa9ff19e83b84354 columnFamilyName f1 2023-02-18 03:01:14,134 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f1/testWithMapReduce=85da828d2ac9cd27aa9ff19e83b84354-f1fe03d9e8b747d4ad078a948a0fa5fa 2023-02-18 03:01:14,134 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(310): Store=85da828d2ac9cd27aa9ff19e83b84354/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,134 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85da828d2ac9cd27aa9ff19e83b84354 2023-02-18 03:01:14,135 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2 2023-02-18 03:01:14,136 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85da828d2ac9cd27aa9ff19e83b84354 columnFamilyName f2 2023-02-18 03:01:14,140 DEBUG [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/85da828d2ac9cd27aa9ff19e83b84354/f2/testWithMapReduce=85da828d2ac9cd27aa9ff19e83b84354-8e893b4c303341188f9bb1fe6ea9ebc4 2023-02-18 03:01:14,140 INFO [StoreOpener-85da828d2ac9cd27aa9ff19e83b84354-1] regionserver.HStore(310): Store=85da828d2ac9cd27aa9ff19e83b84354/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:14,140 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 85da828d2ac9cd27aa9ff19e83b84354; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64640139, jitterRate=-0.036786869168281555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:14,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:14,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 85da828d2ac9cd27aa9ff19e83b84354, disabling compactions & flushes 2023-02-18 03:01:14,166 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:14,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:14,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. after waiting 0 ms 2023-02-18 03:01:14,166 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:14,167 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676689268883.85da828d2ac9cd27aa9ff19e83b84354. 2023-02-18 03:01:14,167 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 85da828d2ac9cd27aa9ff19e83b84354: 2023-02-18 03:01:14,170 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:14,170 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:14,171 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:14,174 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:14,175 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1 2023-02-18 03:01:14,175 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4822485b4615bcd402b16297c6bfd40 columnFamilyName f1 2023-02-18 03:01:14,179 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f1/testWithMapReduce=e4822485b4615bcd402b16297c6bfd40-95b474876e4e4a0a9807adef799d7b52 2023-02-18 03:01:14,179 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(310): Store=e4822485b4615bcd402b16297c6bfd40/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,179 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4822485b4615bcd402b16297c6bfd40 2023-02-18 03:01:14,180 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2 2023-02-18 03:01:14,180 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4822485b4615bcd402b16297c6bfd40 columnFamilyName f2 2023-02-18 03:01:14,185 DEBUG [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33221/user/jenkins/test-data/40ba1052-6e80-fb21-8661-ad18ecea8b2b/testWithMapReduceAndOfflineHBaseMultiRegion/c0fc8501-5d57-4844-adfd-7372ec74afe6/data/default/testWithMapReduce/e4822485b4615bcd402b16297c6bfd40/f2/testWithMapReduce=e4822485b4615bcd402b16297c6bfd40-0c438eaecd6f4ab5aaef41bc07be9a53 2023-02-18 03:01:14,185 INFO [StoreOpener-e4822485b4615bcd402b16297c6bfd40-1] regionserver.HStore(310): Store=e4822485b4615bcd402b16297c6bfd40/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:14,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:14,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e4822485b4615bcd402b16297c6bfd40; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75168344, jitterRate=0.12009561061859131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:14,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:14,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e4822485b4615bcd402b16297c6bfd40, disabling compactions & flushes 2023-02-18 03:01:14,211 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:14,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:14,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. after waiting 0 ms 2023-02-18 03:01:14,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:14,212 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676689268883.e4822485b4615bcd402b16297c6bfd40. 2023-02-18 03:01:14,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e4822485b4615bcd402b16297c6bfd40: 2023-02-18 03:01:14,835 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:14,836 WARN [Listener at localhost.localdomain/46707] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:14,852 INFO [Listener at localhost.localdomain/46707] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:14,965 WARN [BP-1263943231-148.251.75.209-1676689266517 heartbeating to localhost.localdomain/127.0.0.1:33221] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:14,965 WARN [BP-1263943231-148.251.75.209-1676689266517 heartbeating to localhost.localdomain/127.0.0.1:33221] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1263943231-148.251.75.209-1676689266517 (Datanode Uuid f0b33787-61ce-4cbb-acb7-47cd28308fd3) service to localhost.localdomain/127.0.0.1:33221 2023-02-18 03:01:14,966 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/dfs/data/data3/current/BP-1263943231-148.251.75.209-1676689266517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:14,967 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/dfs/data/data4/current/BP-1263943231-148.251.75.209-1676689266517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:14,969 WARN [Listener at localhost.localdomain/46707] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:14,973 INFO [Listener at localhost.localdomain/46707] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:15,077 WARN [BP-1263943231-148.251.75.209-1676689266517 heartbeating to localhost.localdomain/127.0.0.1:33221] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:15,078 WARN [BP-1263943231-148.251.75.209-1676689266517 heartbeating to localhost.localdomain/127.0.0.1:33221] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1263943231-148.251.75.209-1676689266517 (Datanode Uuid f263734a-f319-4830-a42e-f54af7c42acd) service to localhost.localdomain/127.0.0.1:33221 2023-02-18 03:01:15,080 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/dfs/data/data1/current/BP-1263943231-148.251.75.209-1676689266517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:15,081 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/cluster_32b614de-47d0-b382-ba75-f721bed4c484/dfs/data/data2/current/BP-1263943231-148.251.75.209-1676689266517] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:15,092 INFO [Listener at localhost.localdomain/46707] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:15,216 INFO [Listener at localhost.localdomain/46707] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:15,275 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:15,289 INFO [Listener at localhost.localdomain/46707] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 101) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost.localdomain:33221 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/46707 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:33221 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost.localdomain:33221 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:33221 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:33221 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:33221 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,40981,1676689267123)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:33221 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 545), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 194) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3434 (was 3913) 2023-02-18 03:01:15,302 INFO [Listener at localhost.localdomain/46707] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=165, AvailableMemoryMB=3434 2023-02-18 03:01:15,312 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop.log.dir so I do NOT create it in target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e 2023-02-18 03:01:15,312 WARN [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 03:01:15,312 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop.tmp.dir so I do NOT create it in target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e 2023-02-18 03:01:15,312 WARN [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b86d6c4e-ad62-c3fd-0085-2f526a5e9932/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 03:01:15,312 DEBUG [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e 2023-02-18 03:01:15,312 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a, deleteOnExit=true 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/test.cache.data in system properties and HBase conf 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:01:15,313 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:01:15,314 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:01:15,314 DEBUG [Listener at localhost.localdomain/46707] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:01:15,314 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:15,314 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:15,314 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:01:15,315 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:01:15,316 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:01:15,316 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:15,316 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:01:15,316 INFO [Listener at localhost.localdomain/46707] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:01:15,319 WARN [Listener at localhost.localdomain/46707] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:15,320 WARN [Listener at localhost.localdomain/46707] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:15,345 WARN [Listener at localhost.localdomain/46707] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:15,348 INFO [Listener at localhost.localdomain/46707] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:15,354 INFO [Listener at localhost.localdomain/46707] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/java.io.tmpdir/Jetty_localhost_localdomain_44793_hdfs____bv578r/webapp 2023-02-18 03:01:15,429 INFO [Listener at localhost.localdomain/46707] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:44793 2023-02-18 03:01:15,432 WARN [Listener at localhost.localdomain/46707] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:15,432 WARN [Listener at localhost.localdomain/46707] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:15,458 WARN [Listener at localhost.localdomain/42559] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:15,471 WARN [Listener at localhost.localdomain/42559] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:15,473 WARN [Listener at localhost.localdomain/42559] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:15,474 INFO [Listener at localhost.localdomain/42559] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:15,479 INFO [Listener at localhost.localdomain/42559] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/java.io.tmpdir/Jetty_localhost_41805_datanode____.x78ewp/webapp 2023-02-18 03:01:15,553 INFO [Listener at localhost.localdomain/42559] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41805 2023-02-18 03:01:15,559 WARN [Listener at localhost.localdomain/44875] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:15,568 WARN [Listener at localhost.localdomain/44875] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:15,570 WARN [Listener at localhost.localdomain/44875] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:15,571 INFO [Listener at localhost.localdomain/44875] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:15,575 INFO [Listener at localhost.localdomain/44875] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/java.io.tmpdir/Jetty_localhost_33909_datanode____431ytl/webapp 2023-02-18 03:01:15,620 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d3d2de53e11bc97: Processing first storage report for DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8 from datanode 702dc118-3b54-4197-9409-4b5b6bf86d06 2023-02-18 03:01:15,621 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d3d2de53e11bc97: from storage DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8 node DatanodeRegistration(127.0.0.1:46643, datanodeUuid=702dc118-3b54-4197-9409-4b5b6bf86d06, infoPort=35341, infoSecurePort=0, ipcPort=44875, storageInfo=lv=-57;cid=testClusterID;nsid=976578610;c=1676689275322), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:15,621 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4d3d2de53e11bc97: Processing first storage report for DS-9cc2ae8d-8445-461b-9356-bacb919e438c from datanode 702dc118-3b54-4197-9409-4b5b6bf86d06 2023-02-18 03:01:15,621 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4d3d2de53e11bc97: from storage DS-9cc2ae8d-8445-461b-9356-bacb919e438c node DatanodeRegistration(127.0.0.1:46643, datanodeUuid=702dc118-3b54-4197-9409-4b5b6bf86d06, infoPort=35341, infoSecurePort=0, ipcPort=44875, storageInfo=lv=-57;cid=testClusterID;nsid=976578610;c=1676689275322), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:15,654 INFO [Listener at localhost.localdomain/44875] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33909 2023-02-18 03:01:15,663 WARN [Listener at localhost.localdomain/39185] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:15,722 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4e4fd515ea73b9a: Processing first storage report for DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea from datanode 5ee63543-3108-4f67-9d31-05ff651fce91 2023-02-18 03:01:15,722 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4e4fd515ea73b9a: from storage DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea node DatanodeRegistration(127.0.0.1:41123, datanodeUuid=5ee63543-3108-4f67-9d31-05ff651fce91, infoPort=35493, infoSecurePort=0, ipcPort=39185, storageInfo=lv=-57;cid=testClusterID;nsid=976578610;c=1676689275322), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:15,722 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc4e4fd515ea73b9a: Processing first storage report for DS-44bc4e84-66de-4098-8fb3-e661520ddfcb from datanode 5ee63543-3108-4f67-9d31-05ff651fce91 2023-02-18 03:01:15,722 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc4e4fd515ea73b9a: from storage DS-44bc4e84-66de-4098-8fb3-e661520ddfcb node DatanodeRegistration(127.0.0.1:41123, datanodeUuid=5ee63543-3108-4f67-9d31-05ff651fce91, infoPort=35493, infoSecurePort=0, ipcPort=39185, storageInfo=lv=-57;cid=testClusterID;nsid=976578610;c=1676689275322), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:15,776 DEBUG [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e 2023-02-18 03:01:15,780 INFO [Listener at localhost.localdomain/39185] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/zookeeper_0, clientPort=63769, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:01:15,782 INFO [Listener at localhost.localdomain/39185] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63769 2023-02-18 03:01:15,782 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,784 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,796 INFO [Listener at localhost.localdomain/39185] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46 with version=8 2023-02-18 03:01:15,797 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,797 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,798 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:42559/user/jenkins/test-data/f5a324ee-5f66-085f-5201-972071c06565/hbase-staging 2023-02-18 03:01:15,799 INFO [Listener at localhost.localdomain/39185] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:15,799 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,799 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,800 INFO [Listener at localhost.localdomain/39185] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:15,800 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,800 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:15,800 INFO [Listener at localhost.localdomain/39185] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:15,801 INFO [Listener at localhost.localdomain/39185] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33711 2023-02-18 03:01:15,802 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,803 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,804 INFO [Listener at localhost.localdomain/39185] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33711 connecting to ZooKeeper ensemble=127.0.0.1:63769 2023-02-18 03:01:15,808 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:337110x0, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:15,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33711-0x1017387bd320000 connected 2023-02-18 03:01:15,820 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:15,820 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:15,821 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:15,822 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33711 2023-02-18 03:01:15,822 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33711 2023-02-18 03:01:15,822 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33711 2023-02-18 03:01:15,823 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33711 2023-02-18 03:01:15,823 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33711 2023-02-18 03:01:15,823 INFO [Listener at localhost.localdomain/39185] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46, hbase.cluster.distributed=false 2023-02-18 03:01:15,838 INFO [Listener at localhost.localdomain/39185] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:15,839 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,839 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,839 INFO [Listener at localhost.localdomain/39185] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:15,839 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,839 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:15,839 INFO [Listener at localhost.localdomain/39185] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:15,841 INFO [Listener at localhost.localdomain/39185] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43865 2023-02-18 03:01:15,841 INFO [Listener at localhost.localdomain/39185] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:15,843 DEBUG [Listener at localhost.localdomain/39185] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:15,843 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,844 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,845 INFO [Listener at localhost.localdomain/39185] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43865 connecting to ZooKeeper ensemble=127.0.0.1:63769 2023-02-18 03:01:15,848 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:438650x0, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:15,848 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): regionserver:438650x0, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:15,849 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): regionserver:438650x0, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:15,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43865-0x1017387bd320001 connected 2023-02-18 03:01:15,855 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:15,856 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43865 2023-02-18 03:01:15,856 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43865 2023-02-18 03:01:15,856 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43865 2023-02-18 03:01:15,858 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43865 2023-02-18 03:01:15,863 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43865 2023-02-18 03:01:15,874 INFO [Listener at localhost.localdomain/39185] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:15,874 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,874 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,874 INFO [Listener at localhost.localdomain/39185] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:15,874 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:15,874 INFO [Listener at localhost.localdomain/39185] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:15,875 INFO [Listener at localhost.localdomain/39185] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:15,877 INFO [Listener at localhost.localdomain/39185] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41397 2023-02-18 03:01:15,877 INFO [Listener at localhost.localdomain/39185] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:15,878 DEBUG [Listener at localhost.localdomain/39185] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:15,879 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,880 INFO [Listener at localhost.localdomain/39185] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,882 INFO [Listener at localhost.localdomain/39185] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41397 connecting to ZooKeeper ensemble=127.0.0.1:63769 2023-02-18 03:01:15,885 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:413970x0, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:15,887 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): regionserver:413970x0, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:15,888 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): regionserver:413970x0, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:15,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41397-0x1017387bd320002 connected 2023-02-18 03:01:15,892 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ZKUtil(164): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:15,894 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41397 2023-02-18 03:01:15,894 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41397 2023-02-18 03:01:15,894 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41397 2023-02-18 03:01:15,895 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41397 2023-02-18 03:01:15,895 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41397 2023-02-18 03:01:15,897 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:15,898 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:15,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:15,899 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:15,899 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:15,899 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:15,900 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:15,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:15,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:15,902 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,33711,1676689275799 from backup master directory 2023-02-18 03:01:15,903 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:15,903 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:15,903 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:15,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:15,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/hbase.id with ID: 6838ab2a-fcb2-4336-a80b-00ab065bc507 2023-02-18 03:01:15,943 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:15,946 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:15,962 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0adc0042 to 127.0.0.1:63769 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:15,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@531ff294, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:15,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:15,974 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:01:15,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:15,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store-tmp 2023-02-18 03:01:15,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:15,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:15,989 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:15,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:15,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:15,989 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:15,990 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:15,990 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:15,991 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/WALs/jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:15,998 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33711%2C1676689275799, suffix=, logDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/WALs/jenkins-hbase20.apache.org,33711,1676689275799, archiveDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/oldWALs, maxLogs=10 2023-02-18 03:01:16,024 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK] 2023-02-18 03:01:16,025 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK] 2023-02-18 03:01:16,034 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/WALs/jenkins-hbase20.apache.org,33711,1676689275799/jenkins-hbase20.apache.org%2C33711%2C1676689275799.1676689275998 2023-02-18 03:01:16,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK], DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK]] 2023-02-18 03:01:16,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:16,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:16,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:16,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:16,037 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:16,038 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:01:16,039 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:01:16,039 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,040 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:16,040 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:16,042 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:16,044 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:16,045 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70508472, jitterRate=0.05065810680389404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:16,045 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:16,047 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:01:16,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:01:16,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:01:16,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:01:16,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 03:01:16,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 03:01:16,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:01:16,051 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:01:16,052 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:01:16,061 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:01:16,061 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:01:16,062 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:01:16,062 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:01:16,062 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:01:16,064 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:16,064 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:01:16,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:01:16,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:01:16,066 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:16,066 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:16,066 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:16,066 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:16,066 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,33711,1676689275799, sessionid=0x1017387bd320000, setting cluster-up flag (Was=false) 2023-02-18 03:01:16,069 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:16,072 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:01:16,073 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:16,074 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:16,076 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:01:16,077 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:16,078 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.hbase-snapshot/.tmp 2023-02-18 03:01:16,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:16,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:16,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:16,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:16,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:16,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:01:16,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:16,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689306082 2023-02-18 03:01:16,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:01:16,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:01:16,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:01:16,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:01:16,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:01:16,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:01:16,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:01:16,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:01:16,084 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:16,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:01:16,084 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:01:16,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:01:16,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:01:16,084 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689276084,5,FailOnTimeoutGroup] 2023-02-18 03:01:16,084 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689276084,5,FailOnTimeoutGroup] 2023-02-18 03:01:16,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:01:16,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,085 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:16,101 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(952): ClusterId : 6838ab2a-fcb2-4336-a80b-00ab065bc507 2023-02-18 03:01:16,101 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:16,102 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(952): ClusterId : 6838ab2a-fcb2-4336-a80b-00ab065bc507 2023-02-18 03:01:16,102 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:16,103 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:16,103 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:16,103 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:16,103 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:16,110 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:16,110 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:16,114 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:16,114 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:16,114 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46 2023-02-18 03:01:16,115 DEBUG [RS:0;jenkins-hbase20:43865] zookeeper.ReadOnlyZKClient(139): Connect 0x0bfbdcac to 127.0.0.1:63769 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:16,115 DEBUG [RS:1;jenkins-hbase20:41397] zookeeper.ReadOnlyZKClient(139): Connect 0x0a59d457 to 127.0.0.1:63769 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:16,131 DEBUG [RS:0;jenkins-hbase20:43865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53c23a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:16,131 DEBUG [RS:0;jenkins-hbase20:43865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103b7dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:16,133 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:16,133 DEBUG [RS:1;jenkins-hbase20:41397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49e3b6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:16,133 DEBUG [RS:1;jenkins-hbase20:41397] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a1bf27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:16,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:16,135 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/info 2023-02-18 03:01:16,136 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:16,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:16,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:16,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:16,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:16,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/table 2023-02-18 03:01:16,141 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:16,142 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,142 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43865 2023-02-18 03:01:16,142 INFO [RS:0;jenkins-hbase20:43865] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:16,142 INFO [RS:0;jenkins-hbase20:43865] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:16,142 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:16,142 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740 2023-02-18 03:01:16,143 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:41397 2023-02-18 03:01:16,143 INFO [RS:1;jenkins-hbase20:41397] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:16,143 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33711,1676689275799 with isa=jenkins-hbase20.apache.org/148.251.75.209:43865, startcode=1676689275838 2023-02-18 03:01:16,143 INFO [RS:1;jenkins-hbase20:41397] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:16,143 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:16,143 DEBUG [RS:0;jenkins-hbase20:43865] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:16,143 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740 2023-02-18 03:01:16,143 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33711,1676689275799 with isa=jenkins-hbase20.apache.org/148.251.75.209:41397, startcode=1676689275874 2023-02-18 03:01:16,143 DEBUG [RS:1;jenkins-hbase20:41397] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:16,146 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43685, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:16,146 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34445, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:16,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33711] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,148 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46 2023-02-18 03:01:16,148 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46 2023-02-18 03:01:16,148 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42559 2023-02-18 03:01:16,148 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:42559 2023-02-18 03:01:16,149 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:16,149 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:16,149 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:16,150 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:16,150 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:16,151 DEBUG [RS:0;jenkins-hbase20:43865] zookeeper.ZKUtil(162): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,151 WARN [RS:0;jenkins-hbase20:43865] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:16,152 INFO [RS:0;jenkins-hbase20:43865] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:16,152 DEBUG [RS:1;jenkins-hbase20:41397] zookeeper.ZKUtil(162): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,152 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,152 WARN [RS:1;jenkins-hbase20:41397] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:16,152 INFO [RS:1;jenkins-hbase20:41397] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:16,152 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41397,1676689275874] 2023-02-18 03:01:16,152 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43865,1676689275838] 2023-02-18 03:01:16,152 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,157 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:16,157 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59683911, jitterRate=-0.11064042150974274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:16,157 DEBUG [RS:1;jenkins-hbase20:41397] zookeeper.ZKUtil(162): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,158 DEBUG [RS:0;jenkins-hbase20:43865] zookeeper.ZKUtil(162): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,157 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:16,158 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:16,158 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:16,158 DEBUG [RS:1;jenkins-hbase20:41397] zookeeper.ZKUtil(162): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,158 DEBUG [RS:0;jenkins-hbase20:43865] zookeeper.ZKUtil(162): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,158 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:16,158 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:16,158 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:16,159 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:16,159 DEBUG [RS:1;jenkins-hbase20:41397] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:16,159 INFO [RS:0;jenkins-hbase20:43865] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:16,159 INFO [RS:1;jenkins-hbase20:41397] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:16,163 INFO [RS:1;jenkins-hbase20:41397] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:16,164 INFO [RS:0;jenkins-hbase20:43865] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:16,164 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:16,164 INFO [RS:1;jenkins-hbase20:41397] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:16,164 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,164 INFO [RS:0;jenkins-hbase20:43865] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:16,164 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:16,164 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:16,164 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,165 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:16,166 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:16,166 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:01:16,166 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:01:16,166 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:16,167 DEBUG [RS:0;jenkins-hbase20:43865] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,167 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,168 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:01:16,168 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,168 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,171 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,171 DEBUG [RS:1;jenkins-hbase20:41397] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:16,171 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,171 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,176 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,176 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,176 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,176 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:01:16,185 INFO [RS:0;jenkins-hbase20:43865] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:16,185 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43865,1676689275838-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,188 INFO [RS:1;jenkins-hbase20:41397] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:16,188 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41397,1676689275874-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,194 INFO [RS:0;jenkins-hbase20:43865] regionserver.Replication(203): jenkins-hbase20.apache.org,43865,1676689275838 started 2023-02-18 03:01:16,194 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,43865,1676689275838, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43865, sessionid=0x1017387bd320001 2023-02-18 03:01:16,194 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:16,194 DEBUG [RS:0;jenkins-hbase20:43865] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,194 DEBUG [RS:0;jenkins-hbase20:43865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43865,1676689275838' 2023-02-18 03:01:16,195 DEBUG [RS:0;jenkins-hbase20:43865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:16,195 DEBUG [RS:0;jenkins-hbase20:43865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:16,196 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:16,196 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:16,196 DEBUG [RS:0;jenkins-hbase20:43865] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,196 DEBUG [RS:0;jenkins-hbase20:43865] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43865,1676689275838' 2023-02-18 03:01:16,196 DEBUG [RS:0;jenkins-hbase20:43865] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:16,196 DEBUG [RS:0;jenkins-hbase20:43865] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:16,197 DEBUG [RS:0;jenkins-hbase20:43865] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:16,197 INFO [RS:0;jenkins-hbase20:43865] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:16,197 INFO [RS:0;jenkins-hbase20:43865] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:16,198 INFO [RS:1;jenkins-hbase20:41397] regionserver.Replication(203): jenkins-hbase20.apache.org,41397,1676689275874 started 2023-02-18 03:01:16,198 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41397,1676689275874, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41397, sessionid=0x1017387bd320002 2023-02-18 03:01:16,198 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:16,198 DEBUG [RS:1;jenkins-hbase20:41397] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,198 DEBUG [RS:1;jenkins-hbase20:41397] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41397,1676689275874' 2023-02-18 03:01:16,198 DEBUG [RS:1;jenkins-hbase20:41397] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:16,199 DEBUG [RS:1;jenkins-hbase20:41397] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41397,1676689275874' 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:16,200 DEBUG [RS:1;jenkins-hbase20:41397] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:16,201 INFO [RS:1;jenkins-hbase20:41397] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:16,201 INFO [RS:1;jenkins-hbase20:41397] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:16,326 DEBUG [jenkins-hbase20:33711] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:01:16,327 DEBUG [jenkins-hbase20:33711] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:16,328 DEBUG [jenkins-hbase20:33711] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:16,328 DEBUG [jenkins-hbase20:33711] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:16,329 DEBUG [jenkins-hbase20:33711] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:16,330 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43865,1676689275838, state=OPENING 2023-02-18 03:01:16,331 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:01:16,332 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:16,332 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:16,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43865,1676689275838}] 2023-02-18 03:01:16,489 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,489 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:16,492 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:16,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:01:16,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:16,502 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43865%2C1676689275838.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838, archiveDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/oldWALs, maxLogs=32 2023-02-18 03:01:16,518 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK] 2023-02-18 03:01:16,519 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK] 2023-02-18 03:01:16,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838/jenkins-hbase20.apache.org%2C43865%2C1676689275838.meta.1676689276504.meta 2023-02-18 03:01:16,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK], DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK]] 2023-02-18 03:01:16,520 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:16,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:01:16,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:01:16,521 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:01:16,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:01:16,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:16,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:01:16,521 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:01:16,522 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:16,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/info 2023-02-18 03:01:16,523 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/info 2023-02-18 03:01:16,524 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:16,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,524 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:16,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:16,525 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:16,525 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:16,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,526 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:16,526 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/table 2023-02-18 03:01:16,526 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/table 2023-02-18 03:01:16,527 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:16,527 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740 2023-02-18 03:01:16,529 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740 2023-02-18 03:01:16,532 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:16,533 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:16,534 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72643900, jitterRate=0.08247846364974976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:16,534 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:16,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689276489 2023-02-18 03:01:16,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:01:16,540 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:01:16,540 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43865,1676689275838, state=OPEN 2023-02-18 03:01:16,541 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:01:16,541 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:16,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:01:16,543 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43865,1676689275838 in 209 msec 2023-02-18 03:01:16,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:01:16,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 377 msec 2023-02-18 03:01:16,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 467 msec 2023-02-18 03:01:16,547 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689276547, completionTime=-1 2023-02-18 03:01:16,547 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:01:16,547 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:01:16,551 DEBUG [hconnection-0x1e3f4172-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:16,553 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:16,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:01:16,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689336555 2023-02-18 03:01:16,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689396555 2023-02-18 03:01:16,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-18 03:01:16,564 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33711,1676689275799-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,564 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33711,1676689275799-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,564 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33711,1676689275799-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,565 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:33711, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,565 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:16,565 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:01:16,565 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:16,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:01:16,568 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:01:16,568 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:16,569 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:16,570 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,571 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219 empty. 2023-02-18 03:01:16,571 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:01:16,587 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:16,588 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 10483082f0a9921449a3a0c26e6e9219, NAME => 'hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp 2023-02-18 03:01:16,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:16,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 10483082f0a9921449a3a0c26e6e9219, disabling compactions & flushes 2023-02-18 03:01:16,595 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. after waiting 0 ms 2023-02-18 03:01:16,595 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,595 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,596 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 10483082f0a9921449a3a0c26e6e9219: 2023-02-18 03:01:16,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:16,604 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689276604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689276604"}]},"ts":"1676689276604"} 2023-02-18 03:01:16,620 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:16,621 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:16,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689276621"}]},"ts":"1676689276621"} 2023-02-18 03:01:16,623 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:01:16,625 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:16,626 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:16,626 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:16,626 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:16,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=10483082f0a9921449a3a0c26e6e9219, ASSIGN}] 2023-02-18 03:01:16,628 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=10483082f0a9921449a3a0c26e6e9219, ASSIGN 2023-02-18 03:01:16,629 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=10483082f0a9921449a3a0c26e6e9219, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43865,1676689275838; forceNewPlan=false, retain=false 2023-02-18 03:01:16,779 INFO [jenkins-hbase20:33711] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:16,780 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=10483082f0a9921449a3a0c26e6e9219, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,781 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689276780"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689276780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689276780"}]},"ts":"1676689276780"} 2023-02-18 03:01:16,782 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 10483082f0a9921449a3a0c26e6e9219, server=jenkins-hbase20.apache.org,43865,1676689275838}] 2023-02-18 03:01:16,938 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,939 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43865%2C1676689275838, suffix=, logDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838, archiveDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/oldWALs, maxLogs=32 2023-02-18 03:01:16,955 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK] 2023-02-18 03:01:16,958 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK] 2023-02-18 03:01:16,960 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838/jenkins-hbase20.apache.org%2C43865%2C1676689275838.1676689276940 2023-02-18 03:01:16,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK], DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK]] 2023-02-18 03:01:16,960 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 10483082f0a9921449a3a0c26e6e9219, NAME => 'hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:16,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:16,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,962 INFO [StoreOpener-10483082f0a9921449a3a0c26e6e9219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,963 DEBUG [StoreOpener-10483082f0a9921449a3a0c26e6e9219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/info 2023-02-18 03:01:16,963 DEBUG [StoreOpener-10483082f0a9921449a3a0c26e6e9219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/info 2023-02-18 03:01:16,964 INFO [StoreOpener-10483082f0a9921449a3a0c26e6e9219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10483082f0a9921449a3a0c26e6e9219 columnFamilyName info 2023-02-18 03:01:16,964 INFO [StoreOpener-10483082f0a9921449a3a0c26e6e9219-1] regionserver.HStore(310): Store=10483082f0a9921449a3a0c26e6e9219/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:16,965 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,965 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:16,969 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:16,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 10483082f0a9921449a3a0c26e6e9219; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62491892, jitterRate=-0.0687982439994812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:16,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 10483082f0a9921449a3a0c26e6e9219: 2023-02-18 03:01:16,971 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219., pid=6, masterSystemTime=1676689276934 2023-02-18 03:01:16,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,972 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:16,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=10483082f0a9921449a3a0c26e6e9219, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:16,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689276972"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689276972"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689276972"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689276972"}]},"ts":"1676689276972"} 2023-02-18 03:01:16,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:01:16,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 10483082f0a9921449a3a0c26e6e9219, server=jenkins-hbase20.apache.org,43865,1676689275838 in 195 msec 2023-02-18 03:01:16,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:01:16,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=10483082f0a9921449a3a0c26e6e9219, ASSIGN in 352 msec 2023-02-18 03:01:16,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:16,981 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689276981"}]},"ts":"1676689276981"} 2023-02-18 03:01:16,983 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:01:16,985 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:16,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 420 msec 2023-02-18 03:01:17,067 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:01:17,068 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:17,068 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:17,072 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:01:17,082 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:17,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-18 03:01:17,094 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:01:17,100 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:17,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-18 03:01:17,115 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:01:17,116 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:01:17,116 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.213sec 2023-02-18 03:01:17,116 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:01:17,116 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:01:17,116 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:01:17,116 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33711,1676689275799-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:01:17,117 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33711,1676689275799-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:01:17,118 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:01:17,203 INFO [RS:1;jenkins-hbase20:41397] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41397%2C1676689275874, suffix=, logDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,41397,1676689275874, archiveDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/oldWALs, maxLogs=32 2023-02-18 03:01:17,209 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ReadOnlyZKClient(139): Connect 0x4afccc75 to 127.0.0.1:63769 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:17,214 DEBUG [Listener at localhost.localdomain/39185] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6493bc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:17,216 DEBUG [hconnection-0x4bcdc65a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:17,217 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49446, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:17,219 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:17,220 DEBUG [Listener at localhost.localdomain/39185] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:01:17,221 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK] 2023-02-18 03:01:17,222 DEBUG [Listener at localhost.localdomain/39185] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:01:17,222 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK] 2023-02-18 03:01:17,224 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52368, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:01:17,224 INFO [RS:1;jenkins-hbase20:41397] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,41397,1676689275874/jenkins-hbase20.apache.org%2C41397%2C1676689275874.1676689277203 2023-02-18 03:01:17,225 DEBUG [RS:1;jenkins-hbase20:41397] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46643,DS-fedefb1d-99fa-495b-bb8b-ac891832f9f8,DISK], DatanodeInfoWithStorage[127.0.0.1:41123,DS-fc12b976-0e29-4b5d-b297-3d817a77b9ea,DISK]] 2023-02-18 03:01:17,225 INFO [Listener at localhost.localdomain/39185] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:17,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:17,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:01:17,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 148.251.75.209:52368 deadline: 1676689337225, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:17,226 INFO [Listener at localhost.localdomain/39185] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-18 03:01:17,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:17,232 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:17,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-18 03:01:17,233 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:17,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:17,234 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,235 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 empty. 2023-02-18 03:01:17,235 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,236 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-18 03:01:17,243 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:17,244 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => d8869bff9475da2dc2aa4a39a77537e1, NAME => 'testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp 2023-02-18 03:01:17,251 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:17,252 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing d8869bff9475da2dc2aa4a39a77537e1, disabling compactions & flushes 2023-02-18 03:01:17,252 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,252 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,252 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. after waiting 0 ms 2023-02-18 03:01:17,252 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,252 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,252 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for d8869bff9475da2dc2aa4a39a77537e1: 2023-02-18 03:01:17,254 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:17,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676689277255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689277255"}]},"ts":"1676689277255"} 2023-02-18 03:01:17,256 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:17,257 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:17,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689277257"}]},"ts":"1676689277257"} 2023-02-18 03:01:17,259 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-18 03:01:17,261 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:17,262 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:17,262 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:17,262 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:17,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, ASSIGN}] 2023-02-18 03:01:17,264 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, ASSIGN 2023-02-18 03:01:17,265 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41397,1676689275874; forceNewPlan=false, retain=false 2023-02-18 03:01:17,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:17,415 INFO [jenkins-hbase20:33711] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:17,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d8869bff9475da2dc2aa4a39a77537e1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:17,417 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676689277417"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689277417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689277417"}]},"ts":"1676689277417"} 2023-02-18 03:01:17,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure d8869bff9475da2dc2aa4a39a77537e1, server=jenkins-hbase20.apache.org,41397,1676689275874}] 2023-02-18 03:01:17,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:17,573 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:17,573 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:17,575 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47182, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:17,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d8869bff9475da2dc2aa4a39a77537e1, NAME => 'testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:17,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:17,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,580 INFO [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,582 DEBUG [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1 2023-02-18 03:01:17,582 DEBUG [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1 2023-02-18 03:01:17,582 INFO [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8869bff9475da2dc2aa4a39a77537e1 columnFamilyName f1 2023-02-18 03:01:17,582 INFO [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] regionserver.HStore(310): Store=d8869bff9475da2dc2aa4a39a77537e1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:17,583 INFO [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,584 DEBUG [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2 2023-02-18 03:01:17,584 DEBUG [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2 2023-02-18 03:01:17,584 INFO [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8869bff9475da2dc2aa4a39a77537e1 columnFamilyName f2 2023-02-18 03:01:17,585 INFO [StoreOpener-d8869bff9475da2dc2aa4a39a77537e1-1] regionserver.HStore(310): Store=d8869bff9475da2dc2aa4a39a77537e1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:17,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:17,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:17,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:17,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d8869bff9475da2dc2aa4a39a77537e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59126183, jitterRate=-0.118951216340065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:17,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d8869bff9475da2dc2aa4a39a77537e1: 2023-02-18 03:01:17,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1., pid=12, masterSystemTime=1676689277573 2023-02-18 03:01:17,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:17,597 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d8869bff9475da2dc2aa4a39a77537e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:17,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676689277597"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689277597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689277597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689277597"}]},"ts":"1676689277597"} 2023-02-18 03:01:17,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 03:01:17,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure d8869bff9475da2dc2aa4a39a77537e1, server=jenkins-hbase20.apache.org,41397,1676689275874 in 180 msec 2023-02-18 03:01:17,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 03:01:17,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, ASSIGN in 338 msec 2023-02-18 03:01:17,602 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:17,602 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689277602"}]},"ts":"1676689277602"} 2023-02-18 03:01:17,603 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-18 03:01:17,605 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:17,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 376 msec 2023-02-18 03:01:17,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:17,839 INFO [Listener at localhost.localdomain/39185] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-18 03:01:17,839 DEBUG [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-18 03:01:17,840 INFO [Listener at localhost.localdomain/39185] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:17,842 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-18 03:01:17,843 INFO [Listener at localhost.localdomain/39185] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:17,843 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-18 03:01:17,844 INFO [Listener at localhost.localdomain/39185] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:01:17,869 DEBUG [hconnection-0x4bcdc65a-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:17,893 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:17,908 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41397] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,064 INFO [Listener at localhost.localdomain/39185] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:01:18,064 INFO [Listener at localhost.localdomain/39185] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:01:18,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 03:01:18,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689278065 (current time:1676689278065). 2023-02-18 03:01:18,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:01:18,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] zookeeper.ReadOnlyZKClient(139): Connect 0x1f148019 to 127.0.0.1:63769 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:18,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@654e696f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:18,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:18,073 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49454, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:18,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f148019 to 127.0.0.1:63769 2023-02-18 03:01:18,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:18,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:01:18,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 03:01:18,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 03:01:18,077 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 03:01:18,078 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676689878078 2023-02-18 03:01:18,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-18 03:01:18,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,080 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:18,080 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:01:18,080 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-18 03:01:18,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 03:01:18,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-18 03:01:18,082 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 03:01:18,082 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676689878082 2023-02-18 03:01:18,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-18 03:01:18,095 INFO [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-18 03:01:18,095 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:18,096 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-18 03:01:18,096 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-18 03:01:18,097 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,097 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,098 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:18,098 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,098 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:18,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:18,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:18,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:18,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:18,098 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,098 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:18,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-18 03:01:18,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 03:01:18,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 03:01:18,104 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 03:01:18,104 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 03:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 03:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 03:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41397,1676689275874' joining acquired barrier for procedure (foo) in zk 2023-02-18 03:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 03:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 03:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43865,1676689275838' joining acquired barrier for procedure (foo) in zk 2023-02-18 03:01:18,113 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,113 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:18,113 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,113 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:18,113 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:18,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41397,1676689275874' joining acquired barrier for procedure 'foo' on coordinator 2023-02-18 03:01:18,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59fa0ebb[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:18,115 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-18 03:01:18,115 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,115 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,116 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 03:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 03:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 03:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,43865,1676689275838' in zk 2023-02-18 03:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 03:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:18,116 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,116 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,116 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:18,116 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. started... 2023-02-18 03:01:18,117 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d8869bff9475da2dc2aa4a39a77537e1 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 03:01:18,117 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 03:01:18,118 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:18,118 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 03:01:18,134 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f1/ac7e5b1b1d524f0fb2805809d32faba6 2023-02-18 03:01:18,153 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f2/88032d29ae0d405395fa2ce92962f14a 2023-02-18 03:01:18,158 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f1/ac7e5b1b1d524f0fb2805809d32faba6 as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/ac7e5b1b1d524f0fb2805809d32faba6 2023-02-18 03:01:18,162 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/ac7e5b1b1d524f0fb2805809d32faba6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:18,163 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f2/88032d29ae0d405395fa2ce92962f14a as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/88032d29ae0d405395fa2ce92962f14a 2023-02-18 03:01:18,167 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/88032d29ae0d405395fa2ce92962f14a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:18,168 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for d8869bff9475da2dc2aa4a39a77537e1 in 51ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:18,168 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d8869bff9475da2dc2aa4a39a77537e1: 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.' region-info for snapshot=foo 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/ac7e5b1b1d524f0fb2805809d32faba6] hfiles 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/ac7e5b1b1d524f0fb2805809d32faba6 for snapshot=foo 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/88032d29ae0d405395fa2ce92962f14a] hfiles 2023-02-18 03:01:18,169 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/88032d29ae0d405395fa2ce92962f14a for snapshot=foo 2023-02-18 03:01:18,175 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. completed. 2023-02-18 03:01:18,175 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 03:01:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 03:01:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 03:01:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,41397,1676689275874' in zk 2023-02-18 03:01:18,176 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 03:01:18,176 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,176 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:18,176 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 03:01:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:18,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,41397,1676689275874': 2023-02-18 03:01:18,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41397,1676689275874' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-18 03:01:18,179 INFO [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-18 03:01:18,179 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:18,179 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:18,180 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-18 03:01:18,180 INFO [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:01:18,180 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:18,181 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,181 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:18,181 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:18,182 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,182 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:18,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 03:01:18,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:18,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:18,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:18,183 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:01:18,183 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,183 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:18,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:18,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:18,184 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:18,185 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,192 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:18,192 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:18,192 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:18,192 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:18,192 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:18,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:18,192 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-18 03:01:18,192 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-18 03:01:18,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:18,193 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:18,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:18,193 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:18,194 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:18,194 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,194 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:18,194 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,194 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:18,194 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:18,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.hbase-snapshot/.tmp/foo 2023-02-18 03:01:18,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:18,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.hbase-snapshot/foo 2023-02-18 03:01:18,225 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-18 03:01:18,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.hbase-snapshot/.tmp/foo 2023-02-18 03:01:18,226 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.hbase-snapshot/.tmp/foo 2023-02-18 03:01:18,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676689278079Consolidate snapshot: foo at 1676689278193 (+114 ms)Loading Region manifests for foo at 1676689278193Writing data manifest for foo at 1676689278196 (+3 ms)Verifying snapshot: foo at 1676689278203 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676689278225 (+22 ms) 2023-02-18 03:01:18,227 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-18 03:01:18,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 148 msec 2023-02-18 03:01:18,383 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:18,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-18 03:01:18,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:18,386 INFO [Listener at localhost.localdomain/39185] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:18,391 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 03:01:18,394 INFO [Listener at localhost.localdomain/39185] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:18,404 INFO [Listener at localhost.localdomain/39185] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:18,456 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41397] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,603 INFO [Listener at localhost.localdomain/39185] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:18,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:18,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,613 INFO [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-18 03:01:18,613 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:18,614 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-18 03:01:18,614 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-18 03:01:18,615 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,615 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,616 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:18,616 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:18,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:18,616 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:18,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:18,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,617 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,617 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,619 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-18 03:01:18,619 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:18,631 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-18 03:01:18,632 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-18 03:01:18,632 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-18 03:01:18,632 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:18,632 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43865,1676689275838' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-18 03:01:18,633 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-18 03:01:18,633 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 03:01:18,633 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:18,633 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,633 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. started... 2023-02-18 03:01:18,633 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d8869bff9475da2dc2aa4a39a77537e1 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 03:01:18,634 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,635 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,635 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:18,652 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f1/58fcd046cd244e859bd8ceeb1e1168be 2023-02-18 03:01:18,670 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f2/990b0f7de5884ee88a0a5d6192069e33 2023-02-18 03:01:18,675 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f1/58fcd046cd244e859bd8ceeb1e1168be as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/58fcd046cd244e859bd8ceeb1e1168be 2023-02-18 03:01:18,679 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/58fcd046cd244e859bd8ceeb1e1168be, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:18,679 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/.tmp/f2/990b0f7de5884ee88a0a5d6192069e33 as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/990b0f7de5884ee88a0a5d6192069e33 2023-02-18 03:01:18,683 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/990b0f7de5884ee88a0a5d6192069e33, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:18,684 INFO [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for d8869bff9475da2dc2aa4a39a77537e1 in 51ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:18,684 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d8869bff9475da2dc2aa4a39a77537e1: 2023-02-18 03:01:18,684 DEBUG [rs(jenkins-hbase20.apache.org,41397,1676689275874)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,684 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 03:01:18,684 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 03:01:18,685 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,685 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-18 03:01:18,685 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41397,1676689275874' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-18 03:01:18,686 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,686 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:18,686 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,686 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:18,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41397,1676689275874' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-18 03:01:18,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dc5815c[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:18,688 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-18 03:01:18,688 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,689 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-18 03:01:18,690 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-18 03:01:18,690 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,43865,1676689275838' in zk 2023-02-18 03:01:18,690 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,690 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:18,689 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-18 03:01:18,690 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-18 03:01:18,690 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase20.apache.org,41397,1676689275874' in zk 2023-02-18 03:01:18,690 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-18 03:01:18,690 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:18,691 DEBUG [member: 'jenkins-hbase20.apache.org,43865,1676689275838' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-18 03:01:18,692 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-18 03:01:18,692 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,692 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:18,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:18,692 DEBUG [member: 'jenkins-hbase20.apache.org,41397,1676689275874' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-18 03:01:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase20.apache.org,41397,1676689275874': 2023-02-18 03:01:18,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41397,1676689275874' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-18 03:01:18,695 INFO [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-18 03:01:18,695 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:18,695 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:18,695 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,695 INFO [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:18,704 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,704 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:18,704 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:18,704 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,705 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:18,705 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:18,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:18,705 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:18,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,707 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,707 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:18,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,713 DEBUG [(jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:18,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-18 03:01:18,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:18,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:18,714 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:18,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:18,713 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:18,714 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:18,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:18,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:18,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:18,714 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,714 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:18,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:18,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:18,715 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,715 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,715 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,815 DEBUG [Listener at localhost.localdomain/39185] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:18,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:18,822 INFO [Listener at localhost.localdomain/39185] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676689278065 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:18,822 DEBUG [Listener at localhost.localdomain/39185] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:42559/user/jenkins/test-data/f5a324ee-5f66-085f-5201-972071c06565/foo/f900652f-48d2-4d72-a968-734169f66185/data/default/testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,822 INFO [Listener at localhost.localdomain/39185] snapshot.RestoreSnapshotHelper(239): region to add: d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:18,823 INFO [Listener at localhost.localdomain/39185] snapshot.RestoreSnapshotHelper(585): clone region=d8869bff9475da2dc2aa4a39a77537e1 as d8869bff9475da2dc2aa4a39a77537e1 in snapshot foo 2023-02-18 03:01:18,823 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d8869bff9475da2dc2aa4a39a77537e1, NAME => 'testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:42559/user/jenkins/test-data/f5a324ee-5f66-085f-5201-972071c06565/foo/f900652f-48d2-4d72-a968-734169f66185 2023-02-18 03:01:18,832 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:18,833 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ac7e5b1b1d524f0fb2805809d32faba6 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,835 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 88032d29ae0d405395fa2ce92962f14a from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,838 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d8869bff9475da2dc2aa4a39a77537e1, disabling compactions & flushes 2023-02-18 03:01:18,838 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,838 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,838 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. after waiting 0 ms 2023-02-18 03:01:18,838 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,838 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:18,838 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d8869bff9475da2dc2aa4a39a77537e1: 2023-02-18 03:01:18,838 INFO [Listener at localhost.localdomain/39185] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676689278065 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:18,838 DEBUG [Listener at localhost.localdomain/39185] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:42559/user/jenkins/test-data/f5a324ee-5f66-085f-5201-972071c06565/foo/f900652f-48d2-4d72-a968-734169f66185 2023-02-18 03:01:18,838 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:42559/user/jenkins/test-data/f5a324ee-5f66-085f-5201-972071c06565/foo/f900652f-48d2-4d72-a968-734169f66185 2023-02-18 03:01:18,839 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:18,840 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:18,840 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-18 03:01:18,841 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(699): |----------d8869bff9475da2dc2aa4a39a77537e1/ 2023-02-18 03:01:18,841 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:18,841 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:18,841 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=d8869bff9475da2dc2aa4a39a77537e1-ac7e5b1b1d524f0fb2805809d32faba6 2023-02-18 03:01:18,841 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:18,842 DEBUG [Listener at localhost.localdomain/39185] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=d8869bff9475da2dc2aa4a39a77537e1-88032d29ae0d405395fa2ce92962f14a 2023-02-18 03:01:18,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-18 03:01:18,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-18 03:01:18,849 INFO [Listener at localhost.localdomain/39185] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:18,853 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689278853"}]},"ts":"1676689278853"} 2023-02-18 03:01:18,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:18,855 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-18 03:01:18,856 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-18 03:01:18,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, UNASSIGN}] 2023-02-18 03:01:18,861 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, UNASSIGN 2023-02-18 03:01:18,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d8869bff9475da2dc2aa4a39a77537e1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:18,863 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676689278863"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689278863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689278863"}]},"ts":"1676689278863"} 2023-02-18 03:01:18,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure d8869bff9475da2dc2aa4a39a77537e1, server=jenkins-hbase20.apache.org,41397,1676689275874}] 2023-02-18 03:01:18,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:19,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:19,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d8869bff9475da2dc2aa4a39a77537e1, disabling compactions & flushes 2023-02-18 03:01:19,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:19,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:19,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. after waiting 0 ms 2023-02-18 03:01:19,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:19,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:19,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1. 2023-02-18 03:01:19,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d8869bff9475da2dc2aa4a39a77537e1: 2023-02-18 03:01:19,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:19,030 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d8869bff9475da2dc2aa4a39a77537e1, regionState=CLOSED 2023-02-18 03:01:19,030 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676689279030"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689279030"}]},"ts":"1676689279030"} 2023-02-18 03:01:19,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 03:01:19,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure d8869bff9475da2dc2aa4a39a77537e1, server=jenkins-hbase20.apache.org,41397,1676689275874 in 167 msec 2023-02-18 03:01:19,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 03:01:19,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=d8869bff9475da2dc2aa4a39a77537e1, UNASSIGN in 177 msec 2023-02-18 03:01:19,037 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689279036"}]},"ts":"1676689279036"} 2023-02-18 03:01:19,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-18 03:01:19,040 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-18 03:01:19,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 191 msec 2023-02-18 03:01:19,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:19,157 INFO [Listener at localhost.localdomain/39185] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-18 03:01:19,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,161 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,162 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:19,166 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:19,168 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1, FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2, FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/recovered.edits] 2023-02-18 03:01:19,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/58fcd046cd244e859bd8ceeb1e1168be to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/archive/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/58fcd046cd244e859bd8ceeb1e1168be 2023-02-18 03:01:19,175 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/ac7e5b1b1d524f0fb2805809d32faba6 to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/archive/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f1/ac7e5b1b1d524f0fb2805809d32faba6 2023-02-18 03:01:19,179 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/88032d29ae0d405395fa2ce92962f14a to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/archive/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/88032d29ae0d405395fa2ce92962f14a 2023-02-18 03:01:19,180 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/990b0f7de5884ee88a0a5d6192069e33 to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/archive/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/f2/990b0f7de5884ee88a0a5d6192069e33 2023-02-18 03:01:19,185 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/recovered.edits/12.seqid to hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/archive/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1/recovered.edits/12.seqid 2023-02-18 03:01:19,186 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/.tmp/data/default/testInitTableSnapshotMapperJobConfig/d8869bff9475da2dc2aa4a39a77537e1 2023-02-18 03:01:19,187 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-18 03:01:19,190 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,192 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-18 03:01:19,196 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-18 03:01:19,198 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,198 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-18 03:01:19,198 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689279198"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:19,200 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 03:01:19,201 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d8869bff9475da2dc2aa4a39a77537e1, NAME => 'testInitTableSnapshotMapperJobConfig,,1676689277229.d8869bff9475da2dc2aa4a39a77537e1.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 03:01:19,201 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-18 03:01:19,201 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676689279201"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:19,211 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-18 03:01:19,213 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-18 03:01:19,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 55 msec 2023-02-18 03:01:19,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33711] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:19,264 INFO [Listener at localhost.localdomain/39185] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-18 03:01:19,265 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:19,265 INFO [Listener at localhost.localdomain/39185] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:19,265 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4afccc75 to 127.0.0.1:63769 2023-02-18 03:01:19,265 DEBUG [Listener at localhost.localdomain/39185] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,265 DEBUG [Listener at localhost.localdomain/39185] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:19,265 DEBUG [Listener at localhost.localdomain/39185] util.JVMClusterUtil(257): Found active master hash=1597045838, stopped=false 2023-02-18 03:01:19,265 INFO [Listener at localhost.localdomain/39185] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:19,266 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:19,266 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:19,266 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:19,266 INFO [Listener at localhost.localdomain/39185] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:19,266 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:19,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:19,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:19,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:19,268 DEBUG [Listener at localhost.localdomain/39185] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0adc0042 to 127.0.0.1:63769 2023-02-18 03:01:19,268 DEBUG [Listener at localhost.localdomain/39185] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,269 INFO [Listener at localhost.localdomain/39185] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,43865,1676689275838' ***** 2023-02-18 03:01:19,269 INFO [Listener at localhost.localdomain/39185] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:19,269 INFO [Listener at localhost.localdomain/39185] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41397,1676689275874' ***** 2023-02-18 03:01:19,269 INFO [RS:0;jenkins-hbase20:43865] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:19,269 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:19,269 INFO [RS:0;jenkins-hbase20:43865] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:19,269 INFO [Listener at localhost.localdomain/39185] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:19,269 INFO [RS:0;jenkins-hbase20:43865] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:19,269 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(3304): Received CLOSE for 10483082f0a9921449a3a0c26e6e9219 2023-02-18 03:01:19,270 INFO [RS:1;jenkins-hbase20:41397] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:19,272 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:19,272 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:19,272 DEBUG [RS:0;jenkins-hbase20:43865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bfbdcac to 127.0.0.1:63769 2023-02-18 03:01:19,272 INFO [RS:1;jenkins-hbase20:41397] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 10483082f0a9921449a3a0c26e6e9219, disabling compactions & flushes 2023-02-18 03:01:19,273 DEBUG [RS:0;jenkins-hbase20:43865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:19,273 INFO [RS:0;jenkins-hbase20:43865] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:19,273 INFO [RS:1;jenkins-hbase20:41397] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:19,273 INFO [RS:0;jenkins-hbase20:43865] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:19,273 INFO [RS:0;jenkins-hbase20:43865] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:19,273 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:19,273 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. after waiting 0 ms 2023-02-18 03:01:19,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:19,274 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 10483082f0a9921449a3a0c26e6e9219 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:19,274 DEBUG [RS:1;jenkins-hbase20:41397] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a59d457 to 127.0.0.1:63769 2023-02-18 03:01:19,274 DEBUG [RS:1;jenkins-hbase20:41397] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,274 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41397,1676689275874; all regions closed. 2023-02-18 03:01:19,275 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:19,275 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 03:01:19,276 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1479): Online Regions={10483082f0a9921449a3a0c26e6e9219=hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219., 1588230740=hbase:meta,,1.1588230740} 2023-02-18 03:01:19,276 DEBUG [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1505): Waiting on 10483082f0a9921449a3a0c26e6e9219, 1588230740 2023-02-18 03:01:19,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:19,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:19,280 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:19,280 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:19,280 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:19,280 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-18 03:01:19,284 DEBUG [RS:1;jenkins-hbase20:41397] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/oldWALs 2023-02-18 03:01:19,284 INFO [RS:1;jenkins-hbase20:41397] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41397%2C1676689275874:(num 1676689277203) 2023-02-18 03:01:19,284 DEBUG [RS:1;jenkins-hbase20:41397] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,284 INFO [RS:1;jenkins-hbase20:41397] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:19,284 INFO [RS:1;jenkins-hbase20:41397] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:19,285 INFO [RS:1;jenkins-hbase20:41397] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:19,285 INFO [RS:1;jenkins-hbase20:41397] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:19,285 INFO [RS:1;jenkins-hbase20:41397] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:19,285 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:19,286 INFO [RS:1;jenkins-hbase20:41397] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41397 2023-02-18 03:01:19,318 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:19,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/.tmp/info/e447c7305ee6477b985da4a8ee9c892f 2023-02-18 03:01:19,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/.tmp/info/e447c7305ee6477b985da4a8ee9c892f as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/info/e447c7305ee6477b985da4a8ee9c892f 2023-02-18 03:01:19,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/info/e447c7305ee6477b985da4a8ee9c892f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:19,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 10483082f0a9921449a3a0c26e6e9219 in 58ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:19,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/.tmp/info/3bb74ed0b0864bb8af70ac12b14ead98 2023-02-18 03:01:19,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bb74ed0b0864bb8af70ac12b14ead98 2023-02-18 03:01:19,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/namespace/10483082f0a9921449a3a0c26e6e9219/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:19,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:19,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 10483082f0a9921449a3a0c26e6e9219: 2023-02-18 03:01:19,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689276565.10483082f0a9921449a3a0c26e6e9219. 2023-02-18 03:01:19,359 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/.tmp/rep_barrier/34402757480b485eb465a53e95600381 2023-02-18 03:01:19,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34402757480b485eb465a53e95600381 2023-02-18 03:01:19,373 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:19,374 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:19,374 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:19,374 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41397,1676689275874 2023-02-18 03:01:19,374 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@39d14459 rejected from java.util.concurrent.ThreadPoolExecutor@3deec7bb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,374 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:19,374 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a9ec540 rejected from java.util.concurrent.ThreadPoolExecutor@3deec7bb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/.tmp/table/3c5415dc11924bedb1e494c9b458b6e5 2023-02-18 03:01:19,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c5415dc11924bedb1e494c9b458b6e5 2023-02-18 03:01:19,396 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/.tmp/info/3bb74ed0b0864bb8af70ac12b14ead98 as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/info/3bb74ed0b0864bb8af70ac12b14ead98 2023-02-18 03:01:19,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bb74ed0b0864bb8af70ac12b14ead98 2023-02-18 03:01:19,400 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/info/3bb74ed0b0864bb8af70ac12b14ead98, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 03:01:19,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/.tmp/rep_barrier/34402757480b485eb465a53e95600381 as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/rep_barrier/34402757480b485eb465a53e95600381 2023-02-18 03:01:19,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34402757480b485eb465a53e95600381 2023-02-18 03:01:19,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/rep_barrier/34402757480b485eb465a53e95600381, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 03:01:19,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/.tmp/table/3c5415dc11924bedb1e494c9b458b6e5 as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/table/3c5415dc11924bedb1e494c9b458b6e5 2023-02-18 03:01:19,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c5415dc11924bedb1e494c9b458b6e5 2023-02-18 03:01:19,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/table/3c5415dc11924bedb1e494c9b458b6e5, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 03:01:19,412 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4345, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 132ms, sequenceid=21, compaction requested=false 2023-02-18 03:01:19,416 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 03:01:19,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:19,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:19,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:19,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:19,476 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,43865,1676689275838; all regions closed. 2023-02-18 03:01:19,477 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41397,1676689275874] 2023-02-18 03:01:19,477 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41397,1676689275874; numProcessing=1 2023-02-18 03:01:19,478 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41397,1676689275874 already deleted, retry=false 2023-02-18 03:01:19,478 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41397,1676689275874 expired; onlineServers=1 2023-02-18 03:01:19,479 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838/jenkins-hbase20.apache.org%2C43865%2C1676689275838.meta.1676689276504.meta not finished, retry = 0 2023-02-18 03:01:19,577 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:19,577 INFO [RS:1;jenkins-hbase20:41397] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41397,1676689275874; zookeeper connection closed. 2023-02-18 03:01:19,577 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2466059 rejected from java.util.concurrent.ThreadPoolExecutor@3deec7bb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,580 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4562a634] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4562a634 2023-02-18 03:01:19,580 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:41397-0x1017387bd320002, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:19,580 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14fbd3b0 rejected from java.util.concurrent.ThreadPoolExecutor@3deec7bb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,583 DEBUG [RS:0;jenkins-hbase20:43865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/oldWALs 2023-02-18 03:01:19,583 INFO [RS:0;jenkins-hbase20:43865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43865%2C1676689275838.meta:.meta(num 1676689276504) 2023-02-18 03:01:19,586 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/WALs/jenkins-hbase20.apache.org,43865,1676689275838/jenkins-hbase20.apache.org%2C43865%2C1676689275838.1676689276940 not finished, retry = 0 2023-02-18 03:01:19,691 DEBUG [RS:0;jenkins-hbase20:43865] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/oldWALs 2023-02-18 03:01:19,691 INFO [RS:0;jenkins-hbase20:43865] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43865%2C1676689275838:(num 1676689276940) 2023-02-18 03:01:19,691 DEBUG [RS:0;jenkins-hbase20:43865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,691 INFO [RS:0;jenkins-hbase20:43865] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:19,692 INFO [RS:0;jenkins-hbase20:43865] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:19,692 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:19,694 INFO [RS:0;jenkins-hbase20:43865] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43865 2023-02-18 03:01:19,695 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43865,1676689275838 2023-02-18 03:01:19,695 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:19,695 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43865,1676689275838] 2023-02-18 03:01:19,695 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43865,1676689275838; numProcessing=2 2023-02-18 03:01:19,696 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43865,1676689275838 already deleted, retry=false 2023-02-18 03:01:19,696 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,43865,1676689275838 expired; onlineServers=0 2023-02-18 03:01:19,696 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33711,1676689275799' ***** 2023-02-18 03:01:19,696 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:19,697 DEBUG [M:0;jenkins-hbase20:33711] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b0f6370, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:19,697 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33711,1676689275799 2023-02-18 03:01:19,697 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33711,1676689275799; all regions closed. 2023-02-18 03:01:19,697 DEBUG [M:0;jenkins-hbase20:33711] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:19,697 DEBUG [M:0;jenkins-hbase20:33711] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:19,698 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:19,698 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689276084] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689276084,5,FailOnTimeoutGroup] 2023-02-18 03:01:19,698 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689276084] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689276084,5,FailOnTimeoutGroup] 2023-02-18 03:01:19,698 DEBUG [M:0;jenkins-hbase20:33711] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:19,700 INFO [M:0;jenkins-hbase20:33711] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:19,700 INFO [M:0;jenkins-hbase20:33711] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:19,700 INFO [M:0;jenkins-hbase20:33711] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:19,700 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:19,700 DEBUG [M:0;jenkins-hbase20:33711] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:19,700 INFO [M:0;jenkins-hbase20:33711] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:19,700 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:19,701 ERROR [M:0;jenkins-hbase20:33711] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 03:01:19,701 INFO [M:0;jenkins-hbase20:33711] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:19,701 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:19,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:19,702 DEBUG [M:0;jenkins-hbase20:33711] zookeeper.ZKUtil(398): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:19,702 WARN [M:0;jenkins-hbase20:33711] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:19,702 INFO [M:0;jenkins-hbase20:33711] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:19,703 INFO [M:0;jenkins-hbase20:33711] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:19,704 DEBUG [M:0;jenkins-hbase20:33711] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:19,704 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:19,704 DEBUG [M:0;jenkins-hbase20:33711] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:19,704 DEBUG [M:0;jenkins-hbase20:33711] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:19,704 DEBUG [M:0;jenkins-hbase20:33711] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:19,704 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.94 KB heapSize=66.91 KB 2023-02-18 03:01:19,722 INFO [M:0;jenkins-hbase20:33711] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.94 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ad291ac06a804ecd84d470478031ccff 2023-02-18 03:01:19,725 DEBUG [M:0;jenkins-hbase20:33711] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ad291ac06a804ecd84d470478031ccff as hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ad291ac06a804ecd84d470478031ccff 2023-02-18 03:01:19,729 INFO [M:0;jenkins-hbase20:33711] regionserver.HStore(1080): Added hdfs://localhost.localdomain:42559/user/jenkins/test-data/9bb984ae-0faf-41f5-4169-c9863da37a46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ad291ac06a804ecd84d470478031ccff, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 03:01:19,730 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegion(2947): Finished flush of dataSize ~55.94 KB/57286, heapSize ~66.89 KB/68496, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=132, compaction requested=false 2023-02-18 03:01:19,730 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:19,730 DEBUG [M:0;jenkins-hbase20:33711] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:19,733 INFO [M:0;jenkins-hbase20:33711] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:19,733 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:19,734 INFO [M:0;jenkins-hbase20:33711] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33711 2023-02-18 03:01:19,735 DEBUG [M:0;jenkins-hbase20:33711] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,33711,1676689275799 already deleted, retry=false 2023-02-18 03:01:19,796 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:19,796 INFO [RS:0;jenkins-hbase20:43865] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,43865,1676689275838; zookeeper connection closed. 2023-02-18 03:01:19,796 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4ab3acf0 rejected from java.util.concurrent.ThreadPoolExecutor@4e8c217e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,796 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): regionserver:43865-0x1017387bd320001, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:19,796 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f85167a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f85167a 2023-02-18 03:01:19,796 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6dccb98e rejected from java.util.concurrent.ThreadPoolExecutor@4e8c217e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,797 INFO [Listener at localhost.localdomain/39185] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:19,896 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:19,896 INFO [M:0;jenkins-hbase20:33711] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33711,1676689275799; zookeeper connection closed. 2023-02-18 03:01:19,896 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@610c0d27 rejected from java.util.concurrent.ThreadPoolExecutor@653395de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,897 DEBUG [Listener at localhost.localdomain/39185-EventThread] zookeeper.ZKWatcher(600): master:33711-0x1017387bd320000, quorum=127.0.0.1:63769, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:19,897 ERROR [Listener at localhost.localdomain/39185-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@103fa33a rejected from java.util.concurrent.ThreadPoolExecutor@653395de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:19,897 WARN [Listener at localhost.localdomain/39185] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:19,903 INFO [Listener at localhost.localdomain/39185] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:20,009 WARN [BP-1030022536-148.251.75.209-1676689275322 heartbeating to localhost.localdomain/127.0.0.1:42559] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:20,010 WARN [BP-1030022536-148.251.75.209-1676689275322 heartbeating to localhost.localdomain/127.0.0.1:42559] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1030022536-148.251.75.209-1676689275322 (Datanode Uuid 5ee63543-3108-4f67-9d31-05ff651fce91) service to localhost.localdomain/127.0.0.1:42559 2023-02-18 03:01:20,011 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/dfs/data/data3/current/BP-1030022536-148.251.75.209-1676689275322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:20,011 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/dfs/data/data4/current/BP-1030022536-148.251.75.209-1676689275322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:20,013 WARN [Listener at localhost.localdomain/39185] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:20,017 INFO [Listener at localhost.localdomain/39185] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:20,125 WARN [BP-1030022536-148.251.75.209-1676689275322 heartbeating to localhost.localdomain/127.0.0.1:42559] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:20,125 WARN [BP-1030022536-148.251.75.209-1676689275322 heartbeating to localhost.localdomain/127.0.0.1:42559] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1030022536-148.251.75.209-1676689275322 (Datanode Uuid 702dc118-3b54-4197-9409-4b5b6bf86d06) service to localhost.localdomain/127.0.0.1:42559 2023-02-18 03:01:20,127 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/dfs/data/data1/current/BP-1030022536-148.251.75.209-1676689275322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:20,128 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/cluster_e8fe2429-e1e1-9701-ad60-5b8318004c5a/dfs/data/data2/current/BP-1030022536-148.251.75.209-1676689275322] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:20,141 INFO [Listener at localhost.localdomain/39185] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:20,256 INFO [Listener at localhost.localdomain/39185] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:20,271 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:20,282 INFO [Listener at localhost.localdomain/39185] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 158) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,33711,1676689275799)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:42559 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/39185 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost.localdomain:42559 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:42559 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost.localdomain:42559 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:42559 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:42559 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:42559 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 543) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3306 (was 3434) 2023-02-18 03:01:20,291 INFO [Listener at localhost.localdomain/39185] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=165, AvailableMemoryMB=3305 2023-02-18 03:01:20,302 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/hadoop.log.dir so I do NOT create it in target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a 2023-02-18 03:01:20,302 WARN [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 03:01:20,302 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/hadoop.tmp.dir so I do NOT create it in target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a 2023-02-18 03:01:20,302 WARN [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0467f0a6-5eac-b762-4067-8a0946a7cb2e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 03:01:20,303 DEBUG [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d, deleteOnExit=true 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/test.cache.data in system properties and HBase conf 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:01:20,303 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:01:20,304 DEBUG [Listener at localhost.localdomain/39185] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:20,304 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:01:20,305 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:01:20,305 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:01:20,305 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:20,305 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:01:20,305 INFO [Listener at localhost.localdomain/39185] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:01:20,307 WARN [Listener at localhost.localdomain/39185] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:20,307 WARN [Listener at localhost.localdomain/39185] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:20,331 WARN [Listener at localhost.localdomain/39185] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:20,334 INFO [Listener at localhost.localdomain/39185] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:20,347 INFO [Listener at localhost.localdomain/39185] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/java.io.tmpdir/Jetty_localhost_localdomain_38843_hdfs____bsdjbg/webapp 2023-02-18 03:01:20,437 INFO [Listener at localhost.localdomain/39185] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38843 2023-02-18 03:01:20,440 WARN [Listener at localhost.localdomain/39185] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:20,441 WARN [Listener at localhost.localdomain/39185] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:20,492 WARN [Listener at localhost.localdomain/34243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:20,504 WARN [Listener at localhost.localdomain/34243] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:20,506 WARN [Listener at localhost.localdomain/34243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:20,507 INFO [Listener at localhost.localdomain/34243] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:20,512 INFO [Listener at localhost.localdomain/34243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/java.io.tmpdir/Jetty_localhost_42577_datanode____sf4lxa/webapp 2023-02-18 03:01:20,583 INFO [Listener at localhost.localdomain/34243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42577 2023-02-18 03:01:20,590 WARN [Listener at localhost.localdomain/39545] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:20,602 WARN [Listener at localhost.localdomain/39545] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:20,604 WARN [Listener at localhost.localdomain/39545] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:20,605 INFO [Listener at localhost.localdomain/39545] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:20,608 INFO [Listener at localhost.localdomain/39545] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/java.io.tmpdir/Jetty_localhost_41455_datanode____.wo7yaq/webapp 2023-02-18 03:01:20,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d80933453260cda: Processing first storage report for DS-56d8153d-6326-45de-bbb7-ab2253c042cc from datanode 3451acef-1fac-4857-aad8-13c147236475 2023-02-18 03:01:20,680 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d80933453260cda: from storage DS-56d8153d-6326-45de-bbb7-ab2253c042cc node DatanodeRegistration(127.0.0.1:44621, datanodeUuid=3451acef-1fac-4857-aad8-13c147236475, infoPort=43663, infoSecurePort=0, ipcPort=39545, storageInfo=lv=-57;cid=testClusterID;nsid=2107766296;c=1676689280308), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:20,680 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6d80933453260cda: Processing first storage report for DS-5c89cf5b-42b6-4d27-a198-c524bc42670c from datanode 3451acef-1fac-4857-aad8-13c147236475 2023-02-18 03:01:20,680 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6d80933453260cda: from storage DS-5c89cf5b-42b6-4d27-a198-c524bc42670c node DatanodeRegistration(127.0.0.1:44621, datanodeUuid=3451acef-1fac-4857-aad8-13c147236475, infoPort=43663, infoSecurePort=0, ipcPort=39545, storageInfo=lv=-57;cid=testClusterID;nsid=2107766296;c=1676689280308), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:20,704 INFO [Listener at localhost.localdomain/39545] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41455 2023-02-18 03:01:20,710 WARN [Listener at localhost.localdomain/39041] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:20,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb24a9e94e4a18cde: Processing first storage report for DS-d93e86c1-1081-4f49-94b1-b5100659408d from datanode e75122e9-cbb4-4c65-8dfb-b3cd80c10a6c 2023-02-18 03:01:20,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb24a9e94e4a18cde: from storage DS-d93e86c1-1081-4f49-94b1-b5100659408d node DatanodeRegistration(127.0.0.1:35089, datanodeUuid=e75122e9-cbb4-4c65-8dfb-b3cd80c10a6c, infoPort=37197, infoSecurePort=0, ipcPort=39041, storageInfo=lv=-57;cid=testClusterID;nsid=2107766296;c=1676689280308), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:20,774 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb24a9e94e4a18cde: Processing first storage report for DS-ac6865d0-3179-441a-9c95-59a511ae9d44 from datanode e75122e9-cbb4-4c65-8dfb-b3cd80c10a6c 2023-02-18 03:01:20,774 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb24a9e94e4a18cde: from storage DS-ac6865d0-3179-441a-9c95-59a511ae9d44 node DatanodeRegistration(127.0.0.1:35089, datanodeUuid=e75122e9-cbb4-4c65-8dfb-b3cd80c10a6c, infoPort=37197, infoSecurePort=0, ipcPort=39041, storageInfo=lv=-57;cid=testClusterID;nsid=2107766296;c=1676689280308), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:20,822 DEBUG [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a 2023-02-18 03:01:20,825 INFO [Listener at localhost.localdomain/39041] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/zookeeper_0, clientPort=61809, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:01:20,826 INFO [Listener at localhost.localdomain/39041] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61809 2023-02-18 03:01:20,826 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,827 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,844 INFO [Listener at localhost.localdomain/39041] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d with version=8 2023-02-18 03:01:20,844 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,845 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,846 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/hbase-staging 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:20,848 INFO [Listener at localhost.localdomain/39041] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:20,849 INFO [Listener at localhost.localdomain/39041] ipc.NettyRpcServer(120): Bind to /148.251.75.209:45701 2023-02-18 03:01:20,850 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,851 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,851 INFO [Listener at localhost.localdomain/39041] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45701 connecting to ZooKeeper ensemble=127.0.0.1:61809 2023-02-18 03:01:20,858 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:457010x0, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:20,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45701-0x1017387d0e70000 connected 2023-02-18 03:01:20,867 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:20,867 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:20,868 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:20,868 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45701 2023-02-18 03:01:20,868 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45701 2023-02-18 03:01:20,869 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45701 2023-02-18 03:01:20,869 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45701 2023-02-18 03:01:20,869 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45701 2023-02-18 03:01:20,869 INFO [Listener at localhost.localdomain/39041] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d, hbase.cluster.distributed=false 2023-02-18 03:01:20,886 INFO [Listener at localhost.localdomain/39041] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:20,887 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,887 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,887 INFO [Listener at localhost.localdomain/39041] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:20,887 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,887 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:20,887 INFO [Listener at localhost.localdomain/39041] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:20,894 INFO [Listener at localhost.localdomain/39041] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41379 2023-02-18 03:01:20,894 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:20,896 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:20,897 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,897 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,898 INFO [Listener at localhost.localdomain/39041] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41379 connecting to ZooKeeper ensemble=127.0.0.1:61809 2023-02-18 03:01:20,901 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:413790x0, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:20,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41379-0x1017387d0e70001 connected 2023-02-18 03:01:20,917 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:20,917 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:20,917 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:20,923 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41379 2023-02-18 03:01:20,923 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41379 2023-02-18 03:01:20,923 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41379 2023-02-18 03:01:20,924 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41379 2023-02-18 03:01:20,924 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41379 2023-02-18 03:01:20,933 INFO [Listener at localhost.localdomain/39041] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:20,933 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,933 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,933 INFO [Listener at localhost.localdomain/39041] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:20,933 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:20,934 INFO [Listener at localhost.localdomain/39041] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:20,934 INFO [Listener at localhost.localdomain/39041] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:20,934 INFO [Listener at localhost.localdomain/39041] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35897 2023-02-18 03:01:20,935 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:20,936 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:20,936 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,937 INFO [Listener at localhost.localdomain/39041] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,938 INFO [Listener at localhost.localdomain/39041] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35897 connecting to ZooKeeper ensemble=127.0.0.1:61809 2023-02-18 03:01:20,940 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:358970x0, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:20,941 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): regionserver:358970x0, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:20,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35897-0x1017387d0e70002 connected 2023-02-18 03:01:20,942 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:20,942 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:20,945 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35897 2023-02-18 03:01:20,947 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35897 2023-02-18 03:01:20,950 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35897 2023-02-18 03:01:20,950 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35897 2023-02-18 03:01:20,950 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35897 2023-02-18 03:01:20,951 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:20,956 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:20,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:20,958 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:20,958 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:20,958 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:20,958 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:20,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:20,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,45701,1676689280847 from backup master directory 2023-02-18 03:01:20,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:20,960 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:20,960 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:20,961 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:20,961 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:20,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/hbase.id with ID: 47bdc200-7704-4bb7-a996-b56677523be8 2023-02-18 03:01:20,979 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:20,980 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,017 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0fc18305 to 127.0.0.1:61809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:21,028 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c78d257, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:21,029 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:21,029 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:01:21,029 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:21,030 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store-tmp 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:21,037 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:21,037 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:21,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/WALs/jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:21,039 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C45701%2C1676689280847, suffix=, logDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/WALs/jenkins-hbase20.apache.org,45701,1676689280847, archiveDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/oldWALs, maxLogs=10 2023-02-18 03:01:21,058 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK] 2023-02-18 03:01:21,063 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK] 2023-02-18 03:01:21,065 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/WALs/jenkins-hbase20.apache.org,45701,1676689280847/jenkins-hbase20.apache.org%2C45701%2C1676689280847.1676689281040 2023-02-18 03:01:21,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK], DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK]] 2023-02-18 03:01:21,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:21,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:21,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:21,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:21,067 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:21,068 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:01:21,068 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:01:21,070 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,070 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:21,071 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:21,073 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:21,078 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:21,079 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72048736, jitterRate=0.07360982894897461}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:21,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:21,079 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:01:21,081 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:01:21,081 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:01:21,081 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:01:21,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 03:01:21,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 03:01:21,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:01:21,083 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:01:21,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:01:21,097 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:01:21,097 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:01:21,098 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:01:21,098 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:01:21,099 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:01:21,100 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,100 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:01:21,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:01:21,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:01:21,102 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:21,102 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:21,102 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:21,102 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,45701,1676689280847, sessionid=0x1017387d0e70000, setting cluster-up flag (Was=false) 2023-02-18 03:01:21,106 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,108 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:01:21,109 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:21,110 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,113 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:01:21,113 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:21,114 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.hbase-snapshot/.tmp 2023-02-18 03:01:21,115 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:21,115 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:21,115 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:01:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,118 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689311118 2023-02-18 03:01:21,118 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:01:21,118 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:01:21,118 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:01:21,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:01:21,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:01:21,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:01:21,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,119 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:21,119 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:01:21,120 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:21,123 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:01:21,127 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:01:21,127 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:01:21,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:01:21,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:01:21,128 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689281128,5,FailOnTimeoutGroup] 2023-02-18 03:01:21,128 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689281128,5,FailOnTimeoutGroup] 2023-02-18 03:01:21,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:01:21,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,128 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,137 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:21,137 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:21,137 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d 2023-02-18 03:01:21,154 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(952): ClusterId : 47bdc200-7704-4bb7-a996-b56677523be8 2023-02-18 03:01:21,155 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:21,155 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(952): ClusterId : 47bdc200-7704-4bb7-a996-b56677523be8 2023-02-18 03:01:21,155 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:21,161 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:21,161 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:21,161 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:21,161 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:21,163 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:21,163 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:21,165 DEBUG [RS:0;jenkins-hbase20:41379] zookeeper.ReadOnlyZKClient(139): Connect 0x0bcae7d2 to 127.0.0.1:61809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:21,165 DEBUG [RS:1;jenkins-hbase20:35897] zookeeper.ReadOnlyZKClient(139): Connect 0x691e0e4a to 127.0.0.1:61809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:21,172 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:21,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:21,176 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/info 2023-02-18 03:01:21,177 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:21,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:21,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:21,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:21,179 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,179 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:21,181 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/table 2023-02-18 03:01:21,181 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:21,181 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,182 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740 2023-02-18 03:01:21,182 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740 2023-02-18 03:01:21,184 DEBUG [RS:1;jenkins-hbase20:35897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67d9fd19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:21,184 DEBUG [RS:1;jenkins-hbase20:35897] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63e6653a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:21,184 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:21,185 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:21,187 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:21,188 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60293275, jitterRate=-0.10156019032001495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:21,188 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:21,188 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:21,188 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:21,188 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:21,188 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:21,188 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:21,189 DEBUG [RS:0;jenkins-hbase20:41379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50d18db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:21,189 DEBUG [RS:0;jenkins-hbase20:41379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1328ca2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:21,190 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:21,191 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:21,191 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:21,191 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:01:21,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:01:21,193 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:01:21,195 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:01:21,199 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:35897 2023-02-18 03:01:21,200 INFO [RS:1;jenkins-hbase20:35897] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:21,200 INFO [RS:1;jenkins-hbase20:35897] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:21,200 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:21,200 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:41379 2023-02-18 03:01:21,200 INFO [RS:0;jenkins-hbase20:41379] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:21,200 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45701,1676689280847 with isa=jenkins-hbase20.apache.org/148.251.75.209:35897, startcode=1676689280933 2023-02-18 03:01:21,200 INFO [RS:0;jenkins-hbase20:41379] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:21,200 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:21,200 DEBUG [RS:1;jenkins-hbase20:35897] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:21,201 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,45701,1676689280847 with isa=jenkins-hbase20.apache.org/148.251.75.209:41379, startcode=1676689280886 2023-02-18 03:01:21,201 DEBUG [RS:0;jenkins-hbase20:41379] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:21,203 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57579, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:21,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,206 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34631, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:21,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,206 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d 2023-02-18 03:01:21,206 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:34243 2023-02-18 03:01:21,206 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:21,207 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d 2023-02-18 03:01:21,207 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:34243 2023-02-18 03:01:21,207 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:21,207 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:21,209 DEBUG [RS:1;jenkins-hbase20:35897] zookeeper.ZKUtil(162): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,209 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41379,1676689280886] 2023-02-18 03:01:21,209 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35897,1676689280933] 2023-02-18 03:01:21,209 WARN [RS:1;jenkins-hbase20:35897] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:21,209 DEBUG [RS:0;jenkins-hbase20:41379] zookeeper.ZKUtil(162): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,209 INFO [RS:1;jenkins-hbase20:35897] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:21,209 WARN [RS:0;jenkins-hbase20:41379] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:21,209 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,209 INFO [RS:0;jenkins-hbase20:41379] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:21,209 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,215 DEBUG [RS:1;jenkins-hbase20:35897] zookeeper.ZKUtil(162): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,215 DEBUG [RS:0;jenkins-hbase20:41379] zookeeper.ZKUtil(162): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,216 DEBUG [RS:1;jenkins-hbase20:35897] zookeeper.ZKUtil(162): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,216 DEBUG [RS:0;jenkins-hbase20:41379] zookeeper.ZKUtil(162): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,216 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:21,216 DEBUG [RS:0;jenkins-hbase20:41379] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:21,217 INFO [RS:0;jenkins-hbase20:41379] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:21,217 INFO [RS:1;jenkins-hbase20:35897] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:21,218 INFO [RS:0;jenkins-hbase20:41379] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:21,218 INFO [RS:0;jenkins-hbase20:41379] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:21,218 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,218 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:21,221 INFO [RS:1;jenkins-hbase20:35897] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:21,221 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,221 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,221 INFO [RS:1;jenkins-hbase20:35897] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:21,221 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,221 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,221 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,221 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,221 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:21,222 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,222 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:21,222 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,222 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,223 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,223 DEBUG [RS:0;jenkins-hbase20:41379] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,224 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,224 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,225 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,225 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,225 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,226 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,226 DEBUG [RS:1;jenkins-hbase20:35897] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:21,227 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,227 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,227 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,236 INFO [RS:1;jenkins-hbase20:35897] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:21,236 INFO [RS:0;jenkins-hbase20:41379] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:21,237 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35897,1676689280933-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,237 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41379,1676689280886-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,245 INFO [RS:1;jenkins-hbase20:35897] regionserver.Replication(203): jenkins-hbase20.apache.org,35897,1676689280933 started 2023-02-18 03:01:21,245 INFO [RS:0;jenkins-hbase20:41379] regionserver.Replication(203): jenkins-hbase20.apache.org,41379,1676689280886 started 2023-02-18 03:01:21,245 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,35897,1676689280933, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35897, sessionid=0x1017387d0e70002 2023-02-18 03:01:21,245 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41379,1676689280886, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41379, sessionid=0x1017387d0e70001 2023-02-18 03:01:21,245 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:21,245 DEBUG [RS:1;jenkins-hbase20:35897] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,245 DEBUG [RS:1;jenkins-hbase20:35897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35897,1676689280933' 2023-02-18 03:01:21,245 DEBUG [RS:1;jenkins-hbase20:35897] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:21,245 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:21,245 DEBUG [RS:0;jenkins-hbase20:41379] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,245 DEBUG [RS:0;jenkins-hbase20:41379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41379,1676689280886' 2023-02-18 03:01:21,245 DEBUG [RS:0;jenkins-hbase20:41379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41379,1676689280886' 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35897,1676689280933' 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:21,246 DEBUG [RS:0;jenkins-hbase20:41379] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:21,246 DEBUG [RS:1;jenkins-hbase20:35897] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:21,247 INFO [RS:0;jenkins-hbase20:41379] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:21,247 INFO [RS:1;jenkins-hbase20:35897] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:21,247 INFO [RS:1;jenkins-hbase20:35897] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:21,247 INFO [RS:0;jenkins-hbase20:41379] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:21,345 DEBUG [jenkins-hbase20:45701] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:01:21,345 DEBUG [jenkins-hbase20:45701] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:21,348 DEBUG [jenkins-hbase20:45701] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:21,348 DEBUG [jenkins-hbase20:45701] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:21,348 DEBUG [jenkins-hbase20:45701] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:21,350 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35897,1676689280933, state=OPENING 2023-02-18 03:01:21,351 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:01:21,352 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,355 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:21,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:21,510 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,510 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:21,512 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45478, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:21,519 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:01:21,519 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:21,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35897%2C1676689280933.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,35897,1676689280933, archiveDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/oldWALs, maxLogs=32 2023-02-18 03:01:21,533 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK] 2023-02-18 03:01:21,533 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK] 2023-02-18 03:01:21,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,35897,1676689280933/jenkins-hbase20.apache.org%2C35897%2C1676689280933.meta.1676689281521.meta 2023-02-18 03:01:21,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK], DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK]] 2023-02-18 03:01:21,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:21,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:01:21,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:01:21,536 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:01:21,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:01:21,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:21,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:01:21,537 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:01:21,539 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:21,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/info 2023-02-18 03:01:21,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/info 2023-02-18 03:01:21,540 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:21,540 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,540 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:21,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:21,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:21,541 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:21,542 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,542 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:21,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/table 2023-02-18 03:01:21,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/table 2023-02-18 03:01:21,543 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:21,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,544 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740 2023-02-18 03:01:21,545 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740 2023-02-18 03:01:21,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:21,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:21,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64023348, jitterRate=-0.045977771282196045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:21,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:21,548 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689281510 2023-02-18 03:01:21,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:01:21,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:01:21,553 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35897,1676689280933, state=OPEN 2023-02-18 03:01:21,554 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:01:21,554 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:21,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:01:21,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35897,1676689280933 in 199 msec 2023-02-18 03:01:21,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:01:21,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-02-18 03:01:21,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 443 msec 2023-02-18 03:01:21,557 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689281557, completionTime=-1 2023-02-18 03:01:21,558 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:01:21,558 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:01:21,560 DEBUG [hconnection-0x6dd9a6b5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:21,561 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45490, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:21,563 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:01:21,563 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689341563 2023-02-18 03:01:21,563 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689401563 2023-02-18 03:01:21,563 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-18 03:01:21,569 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45701,1676689280847-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,569 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45701,1676689280847-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,569 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45701,1676689280847-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,569 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:45701, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,569 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:21,569 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:01:21,570 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:21,570 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:01:21,572 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:01:21,572 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:21,573 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:21,574 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,574 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088 empty. 2023-02-18 03:01:21,575 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,575 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:01:21,588 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:21,589 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 44bf2f10b1ede7cf040eee5cbbc6a088, NAME => 'hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:21,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:21,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 44bf2f10b1ede7cf040eee5cbbc6a088, disabling compactions & flushes 2023-02-18 03:01:21,598 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. after waiting 0 ms 2023-02-18 03:01:21,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,598 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,598 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 44bf2f10b1ede7cf040eee5cbbc6a088: 2023-02-18 03:01:21,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:21,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689281601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689281601"}]},"ts":"1676689281601"} 2023-02-18 03:01:21,604 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:21,605 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:21,605 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689281605"}]},"ts":"1676689281605"} 2023-02-18 03:01:21,606 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:01:21,609 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:21,609 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:21,609 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:21,610 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:21,612 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=44bf2f10b1ede7cf040eee5cbbc6a088, ASSIGN}] 2023-02-18 03:01:21,613 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=44bf2f10b1ede7cf040eee5cbbc6a088, ASSIGN 2023-02-18 03:01:21,614 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=44bf2f10b1ede7cf040eee5cbbc6a088, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35897,1676689280933; forceNewPlan=false, retain=false 2023-02-18 03:01:21,764 INFO [jenkins-hbase20:45701] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:21,766 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=44bf2f10b1ede7cf040eee5cbbc6a088, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,766 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689281766"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689281766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689281766"}]},"ts":"1676689281766"} 2023-02-18 03:01:21,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 44bf2f10b1ede7cf040eee5cbbc6a088, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:21,926 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,929 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35897%2C1676689280933, suffix=, logDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,35897,1676689280933, archiveDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/oldWALs, maxLogs=32 2023-02-18 03:01:21,946 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK] 2023-02-18 03:01:21,946 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK] 2023-02-18 03:01:21,947 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,35897,1676689280933/jenkins-hbase20.apache.org%2C35897%2C1676689280933.1676689281929 2023-02-18 03:01:21,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK], DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK]] 2023-02-18 03:01:21,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 44bf2f10b1ede7cf040eee5cbbc6a088, NAME => 'hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:21,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:21,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,950 INFO [StoreOpener-44bf2f10b1ede7cf040eee5cbbc6a088-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,951 DEBUG [StoreOpener-44bf2f10b1ede7cf040eee5cbbc6a088-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/info 2023-02-18 03:01:21,951 DEBUG [StoreOpener-44bf2f10b1ede7cf040eee5cbbc6a088-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/info 2023-02-18 03:01:21,951 INFO [StoreOpener-44bf2f10b1ede7cf040eee5cbbc6a088-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44bf2f10b1ede7cf040eee5cbbc6a088 columnFamilyName info 2023-02-18 03:01:21,952 INFO [StoreOpener-44bf2f10b1ede7cf040eee5cbbc6a088-1] regionserver.HStore(310): Store=44bf2f10b1ede7cf040eee5cbbc6a088/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:21,952 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:21,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:21,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 44bf2f10b1ede7cf040eee5cbbc6a088; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71894599, jitterRate=0.07131300866603851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:21,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 44bf2f10b1ede7cf040eee5cbbc6a088: 2023-02-18 03:01:21,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088., pid=6, masterSystemTime=1676689281921 2023-02-18 03:01:21,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,962 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:21,962 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=44bf2f10b1ede7cf040eee5cbbc6a088, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:21,963 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689281962"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689281962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689281962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689281962"}]},"ts":"1676689281962"} 2023-02-18 03:01:21,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:01:21,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 44bf2f10b1ede7cf040eee5cbbc6a088, server=jenkins-hbase20.apache.org,35897,1676689280933 in 196 msec 2023-02-18 03:01:21,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:01:21,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=44bf2f10b1ede7cf040eee5cbbc6a088, ASSIGN in 356 msec 2023-02-18 03:01:21,968 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:21,968 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689281968"}]},"ts":"1676689281968"} 2023-02-18 03:01:21,969 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:01:21,971 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:21,971 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:01:21,972 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:21,972 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:21,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 401 msec 2023-02-18 03:01:21,976 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:01:21,987 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:21,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-18 03:01:21,997 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:01:22,004 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:22,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-18 03:01:22,010 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:01:22,011 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:01:22,011 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.050sec 2023-02-18 03:01:22,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:01:22,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:01:22,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:01:22,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45701,1676689280847-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:01:22,012 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,45701,1676689280847-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:01:22,013 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:01:22,055 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ReadOnlyZKClient(139): Connect 0x21a2b79c to 127.0.0.1:61809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:22,059 DEBUG [Listener at localhost.localdomain/39041] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d09a1ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:22,061 DEBUG [hconnection-0x55a669cc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:22,062 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:22,064 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:22,064 DEBUG [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:01:22,066 DEBUG [Listener at localhost.localdomain/39041] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:01:22,068 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34464, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:01:22,068 INFO [Listener at localhost.localdomain/39041] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:01:22,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 148.251.75.209:34464 deadline: 1676689342069, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,070 INFO [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-18 03:01:22,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:22,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,076 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:22,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-18 03:01:22,076 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:22,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,083 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 empty. 2023-02-18 03:01:22,084 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 empty. 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c empty. 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e empty. 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,085 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,085 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-18 03:01:22,092 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:22,093 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4d32f9f2bb0be8c8c857dafb4d29282b, NAME => 'testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,093 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 180ceaed53360deb602f0fcabd1853ac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,093 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 78d5c9bb5537a60ed3978037c58afef9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 4d32f9f2bb0be8c8c857dafb4d29282b, disabling compactions & flushes 2023-02-18 03:01:22,100 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. after waiting 0 ms 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,100 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,100 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 78d5c9bb5537a60ed3978037c58afef9, disabling compactions & flushes 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 180ceaed53360deb602f0fcabd1853ac, disabling compactions & flushes 2023-02-18 03:01:22,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 35946dbf681d5e4e055dfff4415006a2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. after waiting 0 ms 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. after waiting 0 ms 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,101 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,101 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,102 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:22,102 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:22,102 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8f222a0b965d27bee2ca86ee76c6d541, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,102 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d2d86507c1adce9ee2eac21b9f97e5bc, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,108 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,108 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 35946dbf681d5e4e055dfff4415006a2, disabling compactions & flushes 2023-02-18 03:01:22,108 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,108 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,108 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. after waiting 0 ms 2023-02-18 03:01:22,108 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,108 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,108 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:22,108 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5dc414d3d4cb7f8063614acb97e1846, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,109 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,109 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d2d86507c1adce9ee2eac21b9f97e5bc, disabling compactions & flushes 2023-02-18 03:01:22,109 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,109 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,109 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. after waiting 0 ms 2023-02-18 03:01:22,109 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,109 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,109 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:22,109 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1e26c03cb05d9f1d560ced340dc6c193, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,110 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,110 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8f222a0b965d27bee2ca86ee76c6d541, disabling compactions & flushes 2023-02-18 03:01:22,110 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,110 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,110 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. after waiting 0 ms 2023-02-18 03:01:22,110 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,110 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,111 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:22,111 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 33c551dba25200da53583bfdaa8f761c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing f5dc414d3d4cb7f8063614acb97e1846, disabling compactions & flushes 2023-02-18 03:01:22,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. after waiting 0 ms 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 1e26c03cb05d9f1d560ced340dc6c193, disabling compactions & flushes 2023-02-18 03:01:22,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,115 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:22,115 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. after waiting 0 ms 2023-02-18 03:01:22,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,116 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 55b565f7e665373341fd12e7280a7e8e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp 2023-02-18 03:01:22,116 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:22,117 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 33c551dba25200da53583bfdaa8f761c, disabling compactions & flushes 2023-02-18 03:01:22,118 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. after waiting 0 ms 2023-02-18 03:01:22,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,118 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:22,121 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,121 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 55b565f7e665373341fd12e7280a7e8e, disabling compactions & flushes 2023-02-18 03:01:22,121 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,121 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,121 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. after waiting 0 ms 2023-02-18 03:01:22,121 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,121 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,121 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:22,123 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:22,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689282124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689282124"}]},"ts":"1676689282124"} 2023-02-18 03:01:22,127 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-18 03:01:22,127 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:22,128 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689282127"}]},"ts":"1676689282127"} 2023-02-18 03:01:22,129 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-18 03:01:22,131 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:22,137 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:22,137 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:22,137 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:22,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, ASSIGN}] 2023-02-18 03:01:22,140 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, ASSIGN 2023-02-18 03:01:22,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, ASSIGN 2023-02-18 03:01:22,141 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, ASSIGN 2023-02-18 03:01:22,141 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, ASSIGN 2023-02-18 03:01:22,141 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35897,1676689280933; forceNewPlan=false, retain=false 2023-02-18 03:01:22,141 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41379,1676689280886; forceNewPlan=false, retain=false 2023-02-18 03:01:22,141 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, ASSIGN 2023-02-18 03:01:22,141 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35897,1676689280933; forceNewPlan=false, retain=false 2023-02-18 03:01:22,142 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41379,1676689280886; forceNewPlan=false, retain=false 2023-02-18 03:01:22,142 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, ASSIGN 2023-02-18 03:01:22,142 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, ASSIGN 2023-02-18 03:01:22,142 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41379,1676689280886; forceNewPlan=false, retain=false 2023-02-18 03:01:22,142 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, ASSIGN 2023-02-18 03:01:22,143 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, ASSIGN 2023-02-18 03:01:22,143 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41379,1676689280886; forceNewPlan=false, retain=false 2023-02-18 03:01:22,143 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, ASSIGN 2023-02-18 03:01:22,143 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35897,1676689280933; forceNewPlan=false, retain=false 2023-02-18 03:01:22,143 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35897,1676689280933; forceNewPlan=false, retain=false 2023-02-18 03:01:22,144 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41379,1676689280886; forceNewPlan=false, retain=false 2023-02-18 03:01:22,144 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35897,1676689280933; forceNewPlan=false, retain=false 2023-02-18 03:01:22,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:22,249 INFO [RS:0;jenkins-hbase20:41379] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41379%2C1676689280886, suffix=, logDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,41379,1676689280886, archiveDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/oldWALs, maxLogs=32 2023-02-18 03:01:22,264 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK] 2023-02-18 03:01:22,265 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK] 2023-02-18 03:01:22,268 INFO [RS:0;jenkins-hbase20:41379] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/WALs/jenkins-hbase20.apache.org,41379,1676689280886/jenkins-hbase20.apache.org%2C41379%2C1676689280886.1676689282249 2023-02-18 03:01:22,268 DEBUG [RS:0;jenkins-hbase20:41379] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35089,DS-d93e86c1-1081-4f49-94b1-b5100659408d,DISK], DatanodeInfoWithStorage[127.0.0.1:44621,DS-56d8153d-6326-45de-bbb7-ab2253c042cc,DISK]] 2023-02-18 03:01:22,291 INFO [jenkins-hbase20:45701] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-18 03:01:22,297 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=35946dbf681d5e4e055dfff4415006a2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8f222a0b965d27bee2ca86ee76c6d541, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,297 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=78d5c9bb5537a60ed3978037c58afef9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282297"}]},"ts":"1676689282297"} 2023-02-18 03:01:22,298 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282297"}]},"ts":"1676689282297"} 2023-02-18 03:01:22,297 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=55b565f7e665373341fd12e7280a7e8e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1e26c03cb05d9f1d560ced340dc6c193, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282297"}]},"ts":"1676689282297"} 2023-02-18 03:01:22,298 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282297"}]},"ts":"1676689282297"} 2023-02-18 03:01:22,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689282297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282297"}]},"ts":"1676689282297"} 2023-02-18 03:01:22,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 35946dbf681d5e4e055dfff4415006a2, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:22,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 78d5c9bb5537a60ed3978037c58afef9, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:22,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 8f222a0b965d27bee2ca86ee76c6d541, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:22,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure 1e26c03cb05d9f1d560ced340dc6c193, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:22,302 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=f5dc414d3d4cb7f8063614acb97e1846, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 55b565f7e665373341fd12e7280a7e8e, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:22,302 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282302"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282302"}]},"ts":"1676689282302"} 2023-02-18 03:01:22,303 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4d32f9f2bb0be8c8c857dafb4d29282b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,303 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689282303"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282303"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282303"}]},"ts":"1676689282303"} 2023-02-18 03:01:22,303 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=180ceaed53360deb602f0fcabd1853ac, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,303 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282303"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282303"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282303"}]},"ts":"1676689282303"} 2023-02-18 03:01:22,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure f5dc414d3d4cb7f8063614acb97e1846, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:22,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=33c551dba25200da53583bfdaa8f761c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282304"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282304"}]},"ts":"1676689282304"} 2023-02-18 03:01:22,304 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d2d86507c1adce9ee2eac21b9f97e5bc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,304 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282304"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689282304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689282304"}]},"ts":"1676689282304"} 2023-02-18 03:01:22,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 4d32f9f2bb0be8c8c857dafb4d29282b, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:22,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 180ceaed53360deb602f0fcabd1853ac, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:22,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 33c551dba25200da53583bfdaa8f761c, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:22,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure d2d86507c1adce9ee2eac21b9f97e5bc, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:22,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:22,451 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,451 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:22,452 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:22,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f222a0b965d27bee2ca86ee76c6d541, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-18 03:01:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,456 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,458 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1 2023-02-18 03:01:22,458 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1 2023-02-18 03:01:22,458 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f222a0b965d27bee2ca86ee76c6d541 columnFamilyName f1 2023-02-18 03:01:22,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d2d86507c1adce9ee2eac21b9f97e5bc, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-18 03:01:22,458 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(310): Store=8f222a0b965d27bee2ca86ee76c6d541/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,458 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,460 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2 2023-02-18 03:01:22,460 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2 2023-02-18 03:01:22,460 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f222a0b965d27bee2ca86ee76c6d541 columnFamilyName f2 2023-02-18 03:01:22,461 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(310): Store=8f222a0b965d27bee2ca86ee76c6d541/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,463 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,464 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1 2023-02-18 03:01:22,464 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1 2023-02-18 03:01:22,465 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d86507c1adce9ee2eac21b9f97e5bc columnFamilyName f1 2023-02-18 03:01:22,465 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(310): Store=d2d86507c1adce9ee2eac21b9f97e5bc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,465 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,467 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2 2023-02-18 03:01:22,467 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2 2023-02-18 03:01:22,467 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d86507c1adce9ee2eac21b9f97e5bc columnFamilyName f2 2023-02-18 03:01:22,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:22,467 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(310): Store=d2d86507c1adce9ee2eac21b9f97e5bc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8f222a0b965d27bee2ca86ee76c6d541; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65905452, jitterRate=-0.017932236194610596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:22,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541., pid=23, masterSystemTime=1676689282450 2023-02-18 03:01:22,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:22,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 78d5c9bb5537a60ed3978037c58afef9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-18 03:01:22,477 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8f222a0b965d27bee2ca86ee76c6d541, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,477 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282477"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282477"}]},"ts":"1676689282477"} 2023-02-18 03:01:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d2d86507c1adce9ee2eac21b9f97e5bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61458632, jitterRate=-0.08419501781463623}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:22,478 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc., pid=30, masterSystemTime=1676689282456 2023-02-18 03:01:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,480 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1 2023-02-18 03:01:22,480 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1 2023-02-18 03:01:22,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-18 03:01:22,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 8f222a0b965d27bee2ca86ee76c6d541, server=jenkins-hbase20.apache.org,41379,1676689280886 in 178 msec 2023-02-18 03:01:22,480 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d2d86507c1adce9ee2eac21b9f97e5bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 33c551dba25200da53583bfdaa8f761c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-18 03:01:22,480 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78d5c9bb5537a60ed3978037c58afef9 columnFamilyName f1 2023-02-18 03:01:22,480 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282480"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282480"}]},"ts":"1676689282480"} 2023-02-18 03:01:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, ASSIGN in 342 msec 2023-02-18 03:01:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,481 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(310): Store=78d5c9bb5537a60ed3978037c58afef9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,481 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,481 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,482 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2 2023-02-18 03:01:22,482 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2 2023-02-18 03:01:22,482 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78d5c9bb5537a60ed3978037c58afef9 columnFamilyName f2 2023-02-18 03:01:22,482 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1 2023-02-18 03:01:22,482 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1 2023-02-18 03:01:22,482 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33c551dba25200da53583bfdaa8f761c columnFamilyName f1 2023-02-18 03:01:22,482 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(310): Store=78d5c9bb5537a60ed3978037c58afef9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-18 03:01:22,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure d2d86507c1adce9ee2eac21b9f97e5bc, server=jenkins-hbase20.apache.org,35897,1676689280933 in 174 msec 2023-02-18 03:01:22,483 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(310): Store=33c551dba25200da53583bfdaa8f761c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,483 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, ASSIGN in 345 msec 2023-02-18 03:01:22,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,484 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2 2023-02-18 03:01:22,484 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2 2023-02-18 03:01:22,484 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33c551dba25200da53583bfdaa8f761c columnFamilyName f2 2023-02-18 03:01:22,484 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(310): Store=33c551dba25200da53583bfdaa8f761c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:22,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:22,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 78d5c9bb5537a60ed3978037c58afef9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60080643, jitterRate=-0.10472865402698517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:22,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9., pid=22, masterSystemTime=1676689282450 2023-02-18 03:01:22,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 33c551dba25200da53583bfdaa8f761c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67986270, jitterRate=0.013074368238449097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:22,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 35946dbf681d5e4e055dfff4415006a2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-18 03:01:22,490 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=78d5c9bb5537a60ed3978037c58afef9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c., pid=29, masterSystemTime=1676689282456 2023-02-18 03:01:22,490 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282489"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282489"}]},"ts":"1676689282489"} 2023-02-18 03:01:22,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,491 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4d32f9f2bb0be8c8c857dafb4d29282b, NAME => 'testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-18 03:01:22,491 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=33c551dba25200da53583bfdaa8f761c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,492 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282491"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282491"}]},"ts":"1676689282491"} 2023-02-18 03:01:22,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,492 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1 2023-02-18 03:01:22,493 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1 2023-02-18 03:01:22,493 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35946dbf681d5e4e055dfff4415006a2 columnFamilyName f1 2023-02-18 03:01:22,493 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-18 03:01:22,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 78d5c9bb5537a60ed3978037c58afef9, server=jenkins-hbase20.apache.org,41379,1676689280886 in 192 msec 2023-02-18 03:01:22,494 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(310): Store=35946dbf681d5e4e055dfff4415006a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,494 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, ASSIGN in 356 msec 2023-02-18 03:01:22,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-18 03:01:22,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 33c551dba25200da53583bfdaa8f761c, server=jenkins-hbase20.apache.org,35897,1676689280933 in 187 msec 2023-02-18 03:01:22,495 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2 2023-02-18 03:01:22,495 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2 2023-02-18 03:01:22,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, ASSIGN in 357 msec 2023-02-18 03:01:22,496 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35946dbf681d5e4e055dfff4415006a2 columnFamilyName f2 2023-02-18 03:01:22,496 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(310): Store=35946dbf681d5e4e055dfff4415006a2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:22,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 35946dbf681d5e4e055dfff4415006a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58735572, jitterRate=-0.12477177381515503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:22,501 DEBUG [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f1 2023-02-18 03:01:22,501 DEBUG [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f1 2023-02-18 03:01:22,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2., pid=21, masterSystemTime=1676689282450 2023-02-18 03:01:22,502 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d32f9f2bb0be8c8c857dafb4d29282b columnFamilyName f1 2023-02-18 03:01:22,502 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(310): Store=4d32f9f2bb0be8c8c857dafb4d29282b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,502 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,503 DEBUG [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f2 2023-02-18 03:01:22,504 DEBUG [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f2 2023-02-18 03:01:22,504 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=35946dbf681d5e4e055dfff4415006a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1e26c03cb05d9f1d560ced340dc6c193, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-18 03:01:22,504 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282504"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282504"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282504"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282504"}]},"ts":"1676689282504"} 2023-02-18 03:01:22,504 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d32f9f2bb0be8c8c857dafb4d29282b columnFamilyName f2 2023-02-18 03:01:22,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,504 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(310): Store=4d32f9f2bb0be8c8c857dafb4d29282b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,505 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,506 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1 2023-02-18 03:01:22,506 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1 2023-02-18 03:01:22,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-18 03:01:22,507 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 35946dbf681d5e4e055dfff4415006a2, server=jenkins-hbase20.apache.org,41379,1676689280886 in 206 msec 2023-02-18 03:01:22,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,507 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e26c03cb05d9f1d560ced340dc6c193 columnFamilyName f1 2023-02-18 03:01:22,507 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(310): Store=1e26c03cb05d9f1d560ced340dc6c193/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,507 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, ASSIGN in 369 msec 2023-02-18 03:01:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:22,509 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2 2023-02-18 03:01:22,509 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2 2023-02-18 03:01:22,509 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e26c03cb05d9f1d560ced340dc6c193 columnFamilyName f2 2023-02-18 03:01:22,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,509 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(310): Store=1e26c03cb05d9f1d560ced340dc6c193/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 4d32f9f2bb0be8c8c857dafb4d29282b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62008348, jitterRate=-0.07600361108779907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:22,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b., pid=27, masterSystemTime=1676689282456 2023-02-18 03:01:22,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 180ceaed53360deb602f0fcabd1853ac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-18 03:01:22,512 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4d32f9f2bb0be8c8c857dafb4d29282b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,512 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689282512"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282512"}]},"ts":"1676689282512"} 2023-02-18 03:01:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,513 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:22,514 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1 2023-02-18 03:01:22,515 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1 2023-02-18 03:01:22,515 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 180ceaed53360deb602f0fcabd1853ac columnFamilyName f1 2023-02-18 03:01:22,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-18 03:01:22,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 4d32f9f2bb0be8c8c857dafb4d29282b, server=jenkins-hbase20.apache.org,35897,1676689280933 in 208 msec 2023-02-18 03:01:22,515 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(310): Store=180ceaed53360deb602f0fcabd1853ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,515 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1e26c03cb05d9f1d560ced340dc6c193; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60780606, jitterRate=-0.09429839253425598}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:22,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, ASSIGN in 377 msec 2023-02-18 03:01:22,517 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2 2023-02-18 03:01:22,517 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2 2023-02-18 03:01:22,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193., pid=24, masterSystemTime=1676689282450 2023-02-18 03:01:22,517 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 180ceaed53360deb602f0fcabd1853ac columnFamilyName f2 2023-02-18 03:01:22,517 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(310): Store=180ceaed53360deb602f0fcabd1853ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 55b565f7e665373341fd12e7280a7e8e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-18 03:01:22,518 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=1e26c03cb05d9f1d560ced340dc6c193, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282518"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282518"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282518"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282518"}]},"ts":"1676689282518"} 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,519 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,520 DEBUG [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f1 2023-02-18 03:01:22,521 DEBUG [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f1 2023-02-18 03:01:22,521 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55b565f7e665373341fd12e7280a7e8e columnFamilyName f1 2023-02-18 03:01:22,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-18 03:01:22,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure 1e26c03cb05d9f1d560ced340dc6c193, server=jenkins-hbase20.apache.org,41379,1676689280886 in 219 msec 2023-02-18 03:01:22,521 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(310): Store=55b565f7e665373341fd12e7280a7e8e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,521 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:22,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, ASSIGN in 383 msec 2023-02-18 03:01:22,523 DEBUG [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f2 2023-02-18 03:01:22,523 DEBUG [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f2 2023-02-18 03:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,523 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55b565f7e665373341fd12e7280a7e8e columnFamilyName f2 2023-02-18 03:01:22,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 180ceaed53360deb602f0fcabd1853ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66029448, jitterRate=-0.01608455181121826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:22,523 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(310): Store=55b565f7e665373341fd12e7280a7e8e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac., pid=28, masterSystemTime=1676689282456 2023-02-18 03:01:22,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f5dc414d3d4cb7f8063614acb97e1846, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-18 03:01:22,526 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=180ceaed53360deb602f0fcabd1853ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,526 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282525"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282525"}]},"ts":"1676689282525"} 2023-02-18 03:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,527 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:22,528 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1 2023-02-18 03:01:22,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-18 03:01:22,528 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1 2023-02-18 03:01:22,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 180ceaed53360deb602f0fcabd1853ac, server=jenkins-hbase20.apache.org,35897,1676689280933 in 222 msec 2023-02-18 03:01:22,528 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5dc414d3d4cb7f8063614acb97e1846 columnFamilyName f1 2023-02-18 03:01:22,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,529 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(310): Store=f5dc414d3d4cb7f8063614acb97e1846/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, ASSIGN in 390 msec 2023-02-18 03:01:22,529 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 55b565f7e665373341fd12e7280a7e8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75310067, jitterRate=0.12220744788646698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:22,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e., pid=25, masterSystemTime=1676689282450 2023-02-18 03:01:22,530 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2 2023-02-18 03:01:22,530 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2 2023-02-18 03:01:22,530 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5dc414d3d4cb7f8063614acb97e1846 columnFamilyName f2 2023-02-18 03:01:22,530 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(310): Store=f5dc414d3d4cb7f8063614acb97e1846/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:22,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=55b565f7e665373341fd12e7280a7e8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689282532"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282532"}]},"ts":"1676689282532"} 2023-02-18 03:01:22,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:22,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:22,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-18 03:01:22,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 55b565f7e665373341fd12e7280a7e8e, server=jenkins-hbase20.apache.org,41379,1676689280886 in 231 msec 2023-02-18 03:01:22,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, ASSIGN in 396 msec 2023-02-18 03:01:22,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:22,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened f5dc414d3d4cb7f8063614acb97e1846; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73126942, jitterRate=0.08967635035514832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:22,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:22,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846., pid=26, masterSystemTime=1676689282456 2023-02-18 03:01:22,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:22,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=f5dc414d3d4cb7f8063614acb97e1846, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689282538"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689282538"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689282538"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689282538"}]},"ts":"1676689282538"} 2023-02-18 03:01:22,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-18 03:01:22,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure f5dc414d3d4cb7f8063614acb97e1846, server=jenkins-hbase20.apache.org,35897,1676689280933 in 235 msec 2023-02-18 03:01:22,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-18 03:01:22,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, ASSIGN in 402 msec 2023-02-18 03:01:22,542 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:22,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689282542"}]},"ts":"1676689282542"} 2023-02-18 03:01:22,543 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-18 03:01:22,544 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:22,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 472 msec 2023-02-18 03:01:22,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:22,686 INFO [Listener at localhost.localdomain/39041] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-18 03:01:22,686 DEBUG [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-18 03:01:22,687 INFO [Listener at localhost.localdomain/39041] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:22,691 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-18 03:01:22,691 INFO [Listener at localhost.localdomain/39041] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:22,692 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-18 03:01:22,692 INFO [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:01:22,725 DEBUG [hconnection-0x55a669cc-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:22,732 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40008, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:22,735 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35897] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,737 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41379] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:22,787 INFO [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:01:22,787 INFO [Listener at localhost.localdomain/39041] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:01:22,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 03:01:22,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689282788 (current time:1676689282788). 2023-02-18 03:01:22,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:01:22,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] zookeeper.ReadOnlyZKClient(139): Connect 0x18307ba5 to 127.0.0.1:61809 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:22,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b29b7fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:22,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:22,796 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18307ba5 to 127.0.0.1:61809 2023-02-18 03:01:22,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:22,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:01:22,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 03:01:22,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 03:01:22,799 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 03:01:22,800 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676689882800 2023-02-18 03:01:22,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-18 03:01:22,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,801 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:22,802 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-18 03:01:22,802 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:01:22,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 03:01:22,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-18 03:01:22,803 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 03:01:22,804 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676689882804 2023-02-18 03:01:22,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,823 INFO [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-18 03:01:22,823 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:22,824 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-18 03:01:22,825 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 03:01:22,825 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,825 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,826 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:22,826 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:22,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:22,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,827 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,827 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,827 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:22,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:22,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:22,828 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,828 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-18 03:01:22,831 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-18 03:01:22,831 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:22,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,842 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 03:01:22,842 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 03:01:22,842 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35897,1676689280933' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 03:01:22,842 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-18 03:01:22,842 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:22,842 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 03:01:22,843 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 03:01:22,843 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41379,1676689280886' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 03:01:22,843 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,843 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:22,844 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,844 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,844 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:22,844 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,844 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,844 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35897,1676689280933' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@417f56ea[Count = 1] remaining members to acquire global barrier 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:22,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:22,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:22,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41379,1676689280886' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 03:01:22,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@417f56ea[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:22,846 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 03:01:22,846 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,847 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:22,847 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 03:01:22,847 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 03:01:22,848 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:22,848 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:22,848 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:22,848 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. started... 2023-02-18 03:01:22,849 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 33c551dba25200da53583bfdaa8f761c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. started... 2023-02-18 03:01:22,849 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:22,850 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:22,849 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. started... 2023-02-18 03:01:22,849 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. started... 2023-02-18 03:01:22,849 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-18 03:01:22,851 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:22,851 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8f222a0b965d27bee2ca86ee76c6d541 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:22,851 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:22,850 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,850 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. started... 2023-02-18 03:01:22,851 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:22,850 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. started... 2023-02-18 03:01:22,859 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:22,859 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d2d86507c1adce9ee2eac21b9f97e5bc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:22,851 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:22,860 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:22,861 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:22,861 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:22,862 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-18 03:01:22,862 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 35946dbf681d5e4e055dfff4415006a2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:22,895 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. completed. 2023-02-18 03:01:22,896 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:22,896 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:22,896 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 03:01:22,896 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. started... 2023-02-18 03:01:22,899 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1e26c03cb05d9f1d560ced340dc6c193 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:22,902 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 03:01:22,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:22,903 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:01:22,909 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f1/48617e529a0a4584971b9c61ef6528a7 2023-02-18 03:01:22,910 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. completed. 2023-02-18 03:01:22,910 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:22,910 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:22,910 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-18 03:01:22,910 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. started... 2023-02-18 03:01:22,911 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 180ceaed53360deb602f0fcabd1853ac 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:22,912 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f1/d52ecd4a48a048568be586c94668df0b 2023-02-18 03:01:22,912 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f1/fe757a5146434772a4b74f237c4b9f80 2023-02-18 03:01:22,916 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f1/60764949b3584e7d93cbb6091d4e8f25 2023-02-18 03:01:22,943 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f1/18e2577b6ac44811bc71e063af97c31d 2023-02-18 03:01:22,959 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f2/bb94b60308b14639bffd88091f0da1b8 2023-02-18 03:01:22,971 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f1/fe757a5146434772a4b74f237c4b9f80 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/fe757a5146434772a4b74f237c4b9f80 2023-02-18 03:01:22,973 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f1/6a3831b6c03a4c48a55cba720999916a 2023-02-18 03:01:22,977 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/fe757a5146434772a4b74f237c4b9f80, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:22,978 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f2/bb94b60308b14639bffd88091f0da1b8 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/bb94b60308b14639bffd88091f0da1b8 2023-02-18 03:01:22,987 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f2/31a3db7b44b543da9fd0c17d63db0efd 2023-02-18 03:01:22,995 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f2/8c4a7be9970944b1a54320bcbe3cd4d6 2023-02-18 03:01:23,012 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f1/48617e529a0a4584971b9c61ef6528a7 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/48617e529a0a4584971b9c61ef6528a7 2023-02-18 03:01:23,013 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/bb94b60308b14639bffd88091f0da1b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,015 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f1/d52ecd4a48a048568be586c94668df0b as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/d52ecd4a48a048568be586c94668df0b 2023-02-18 03:01:23,015 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f2/92f14351bef94f599c6227e8598fa0a0 2023-02-18 03:01:23,015 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 35946dbf681d5e4e055dfff4415006a2 in 153ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,015 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/fe757a5146434772a4b74f237c4b9f80] hfiles 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/fe757a5146434772a4b74f237c4b9f80 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/bb94b60308b14639bffd88091f0da1b8] hfiles 2023-02-18 03:01:23,016 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/bb94b60308b14639bffd88091f0da1b8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,017 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f2/3f7db4b011224bb1bdcbd1f0d8d8db07 2023-02-18 03:01:23,021 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/48617e529a0a4584971b9c61ef6528a7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:23,023 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f2/8c4a7be9970944b1a54320bcbe3cd4d6 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/8c4a7be9970944b1a54320bcbe3cd4d6 2023-02-18 03:01:23,024 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f1/60764949b3584e7d93cbb6091d4e8f25 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/60764949b3584e7d93cbb6091d4e8f25 2023-02-18 03:01:23,025 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/d52ecd4a48a048568be586c94668df0b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f2/31a3db7b44b543da9fd0c17d63db0efd as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/31a3db7b44b543da9fd0c17d63db0efd 2023-02-18 03:01:23,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f1/18e2577b6ac44811bc71e063af97c31d as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/18e2577b6ac44811bc71e063af97c31d 2023-02-18 03:01:23,032 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/8c4a7be9970944b1a54320bcbe3cd4d6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:23,033 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 33c551dba25200da53583bfdaa8f761c in 183ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,034 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/60764949b3584e7d93cbb6091d4e8f25, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,035 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/31a3db7b44b543da9fd0c17d63db0efd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,035 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f2/92f14351bef94f599c6227e8598fa0a0 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/92f14351bef94f599c6227e8598fa0a0 2023-02-18 03:01:23,035 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8f222a0b965d27bee2ca86ee76c6d541 in 185ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/d52ecd4a48a048568be586c94668df0b] hfiles 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/48617e529a0a4584971b9c61ef6528a7] hfiles 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/48617e529a0a4584971b9c61ef6528a7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,043 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/d52ecd4a48a048568be586c94668df0b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,044 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/8c4a7be9970944b1a54320bcbe3cd4d6] hfiles 2023-02-18 03:01:23,044 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/31a3db7b44b543da9fd0c17d63db0efd] hfiles 2023-02-18 03:01:23,044 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/31a3db7b44b543da9fd0c17d63db0efd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,044 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/8c4a7be9970944b1a54320bcbe3cd4d6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,070 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f2/c04702413d384823acfc213db6038c37 2023-02-18 03:01:23,071 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/18e2577b6ac44811bc71e063af97c31d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,071 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/92f14351bef94f599c6227e8598fa0a0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,072 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f2/3f7db4b011224bb1bdcbd1f0d8d8db07 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/3f7db4b011224bb1bdcbd1f0d8d8db07 2023-02-18 03:01:23,072 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d2d86507c1adce9ee2eac21b9f97e5bc in 213ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/60764949b3584e7d93cbb6091d4e8f25] hfiles 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/60764949b3584e7d93cbb6091d4e8f25 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/92f14351bef94f599c6227e8598fa0a0] hfiles 2023-02-18 03:01:23,073 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/92f14351bef94f599c6227e8598fa0a0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,074 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. completed. 2023-02-18 03:01:23,075 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:23,075 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:23,075 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 03:01:23,075 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. started... 2023-02-18 03:01:23,076 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 78d5c9bb5537a60ed3978037c58afef9 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-18 03:01:23,082 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f1/6a3831b6c03a4c48a55cba720999916a as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/6a3831b6c03a4c48a55cba720999916a 2023-02-18 03:01:23,083 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. completed. 2023-02-18 03:01:23,083 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:23,083 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:23,083 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-18 03:01:23,083 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. started... 2023-02-18 03:01:23,083 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/3f7db4b011224bb1bdcbd1f0d8d8db07, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,084 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f5dc414d3d4cb7f8063614acb97e1846 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-18 03:01:23,085 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1e26c03cb05d9f1d560ced340dc6c193 in 186ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/18e2577b6ac44811bc71e063af97c31d] hfiles 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/18e2577b6ac44811bc71e063af97c31d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/3f7db4b011224bb1bdcbd1f0d8d8db07] hfiles 2023-02-18 03:01:23,085 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/3f7db4b011224bb1bdcbd1f0d8d8db07 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,092 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/6a3831b6c03a4c48a55cba720999916a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,093 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f2/c04702413d384823acfc213db6038c37 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/c04702413d384823acfc213db6038c37 2023-02-18 03:01:23,102 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. completed. 2023-02-18 03:01:23,102 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:23,102 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 03:01:23,104 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:23,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 03:01:23,105 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/c04702413d384823acfc213db6038c37, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:23,105 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-18 03:01:23,106 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 180ceaed53360deb602f0fcabd1853ac in 195ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/6a3831b6c03a4c48a55cba720999916a] hfiles 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/6a3831b6c03a4c48a55cba720999916a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/c04702413d384823acfc213db6038c37] hfiles 2023-02-18 03:01:23,106 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/c04702413d384823acfc213db6038c37 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,107 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f1/dcb3cbfe4260421b9265ebd07729b7e4 2023-02-18 03:01:23,111 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. completed. 2023-02-18 03:01:23,111 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f1/63e964091d884b2da3aa744345ce6cc6 2023-02-18 03:01:23,111 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:23,111 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 03:01:23,123 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. completed. 2023-02-18 03:01:23,123 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:23,123 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-18 03:01:23,125 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f2/ae20ef37ec734907adb26bc0eeb16cd4 2023-02-18 03:01:23,127 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f2/5dc16e992cae4e86a6e5ac9ceb4ea788 2023-02-18 03:01:23,129 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f1/dcb3cbfe4260421b9265ebd07729b7e4 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/dcb3cbfe4260421b9265ebd07729b7e4 2023-02-18 03:01:23,132 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f1/63e964091d884b2da3aa744345ce6cc6 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/63e964091d884b2da3aa744345ce6cc6 2023-02-18 03:01:23,134 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/dcb3cbfe4260421b9265ebd07729b7e4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,134 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f2/ae20ef37ec734907adb26bc0eeb16cd4 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/ae20ef37ec734907adb26bc0eeb16cd4 2023-02-18 03:01:23,137 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/63e964091d884b2da3aa744345ce6cc6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:23,138 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f2/5dc16e992cae4e86a6e5ac9ceb4ea788 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/5dc16e992cae4e86a6e5ac9ceb4ea788 2023-02-18 03:01:23,139 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/ae20ef37ec734907adb26bc0eeb16cd4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-18 03:01:23,140 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f5dc414d3d4cb7f8063614acb97e1846 in 56ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/dcb3cbfe4260421b9265ebd07729b7e4] hfiles 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/dcb3cbfe4260421b9265ebd07729b7e4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/ae20ef37ec734907adb26bc0eeb16cd4] hfiles 2023-02-18 03:01:23,140 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/ae20ef37ec734907adb26bc0eeb16cd4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,142 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/5dc16e992cae4e86a6e5ac9ceb4ea788, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-18 03:01:23,143 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 78d5c9bb5537a60ed3978037c58afef9 in 66ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/63e964091d884b2da3aa744345ce6cc6] hfiles 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/63e964091d884b2da3aa744345ce6cc6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/5dc16e992cae4e86a6e5ac9ceb4ea788] hfiles 2023-02-18 03:01:23,143 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/5dc16e992cae4e86a6e5ac9ceb4ea788 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,154 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. completed. 2023-02-18 03:01:23,154 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:23,154 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-18 03:01:23,154 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. completed. 2023-02-18 03:01:23,154 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:23,154 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 03:01:23,154 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 03:01:23,154 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 03:01:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,41379,1676689280886' in zk 2023-02-18 03:01:23,156 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,156 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:23,156 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:23,156 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,41379,1676689280886': 2023-02-18 03:01:23,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41379,1676689280886' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 03:01:23,405 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:23,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 03:01:23,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:23,407 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-18 03:01:23,495 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. completed. 2023-02-18 03:01:23,496 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:23,496 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-18 03:01:23,496 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-18 03:01:23,496 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,496 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 03:01:23,496 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,35897,1676689280933' in zk 2023-02-18 03:01:23,498 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 03:01:23,498 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:23,498 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 03:01:23,498 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:23,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,35897,1676689280933': 2023-02-18 03:01:23,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35897,1676689280933' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 03:01:23,506 INFO [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-18 03:01:23,506 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:23,506 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:23,506 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,507 INFO [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:01:23,515 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,515 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,515 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,515 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:23,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,515 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:23,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:23,516 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:23,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:23,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,517 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:23,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:23,519 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,520 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:23,525 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:23,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:23,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:23,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,525 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:23,526 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:23,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:23,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:23,526 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:23,526 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,526 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:23,526 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,526 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-18 03:01:23,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,572 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:23,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676689282800Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676689283526 (+726 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676689283526Writing data manifest for testWithMockedMapReduceMultiRegion at 1676689283536 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676689283546 (+10 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676689283572 (+26 ms) 2023-02-18 03:01:23,573 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-18 03:01:23,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 773 msec 2023-02-18 03:01:23,907 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:23,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-18 03:01:23,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:23,910 INFO [Listener at localhost.localdomain/39041] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:23,917 INFO [Listener at localhost.localdomain/39041] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:23,926 INFO [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:23,950 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35897] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:23,953 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41379] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,003 INFO [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:24,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:24,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,013 INFO [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-18 03:01:24,013 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:24,014 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-18 03:01:24,014 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-18 03:01:24,015 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,015 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,016 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:24,016 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:24,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:24,016 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:24,016 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,016 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,017 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,017 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,024 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-18 03:01:24,024 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:24,025 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 03:01:24,025 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-18 03:01:24,025 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:24,026 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-18 03:01:24,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:24,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. started... 2023-02-18 03:01:24,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:24,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:24,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. started... 2023-02-18 03:01:24,026 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:24,026 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8f222a0b965d27bee2ca86ee76c6d541 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:24,027 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:24,027 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. started... 2023-02-18 03:01:24,027 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 33c551dba25200da53583bfdaa8f761c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 03:01:24,032 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 03:01:24,033 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:24,034 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:24,034 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 03:01:24,034 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:24,034 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. started... 2023-02-18 03:01:24,034 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. started... 2023-02-18 03:01:24,034 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1e26c03cb05d9f1d560ced340dc6c193 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:24,034 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 35946dbf681d5e4e055dfff4415006a2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:24,039 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:24,039 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. started... 2023-02-18 03:01:24,039 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:24,039 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:24,049 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-18 03:01:24,049 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:24,049 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:24,050 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-18 03:01:24,050 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. started... 2023-02-18 03:01:24,050 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 180ceaed53360deb602f0fcabd1853ac 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:24,051 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:24,051 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. started... 2023-02-18 03:01:24,052 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d2d86507c1adce9ee2eac21b9f97e5bc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:24,072 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f1/8df94f0a593942318e9b62797ef38eb0 2023-02-18 03:01:24,077 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f1/b3931ec8305c43b09fae00fe745d146d 2023-02-18 03:01:24,077 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f1/28bb6013ccee4f31a19a8dd39aec11bb 2023-02-18 03:01:24,078 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f1/121a0b54be934cf399e4db47003f3913 2023-02-18 03:01:24,078 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f1/998ebd3e99744f1485e543b4296bfb3d 2023-02-18 03:01:24,081 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f1/c0aee311b3694472bbf95b0f385876c6 2023-02-18 03:01:24,137 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f2/74826de4ac49436ebce6231c3278b417 2023-02-18 03:01:24,142 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f1/8df94f0a593942318e9b62797ef38eb0 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/8df94f0a593942318e9b62797ef38eb0 2023-02-18 03:01:24,146 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/8df94f0a593942318e9b62797ef38eb0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:24,147 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/.tmp/f2/74826de4ac49436ebce6231c3278b417 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/74826de4ac49436ebce6231c3278b417 2023-02-18 03:01:24,147 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f2/1eb8c775d7974df6acb1a6be5a02d7a1 2023-02-18 03:01:24,148 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f2/71c9508b78764e678749d700c5291852 2023-02-18 03:01:24,151 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f2/2e683498a7204136ae57e31b79a1f2c9 2023-02-18 03:01:24,153 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f1/121a0b54be934cf399e4db47003f3913 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/121a0b54be934cf399e4db47003f3913 2023-02-18 03:01:24,155 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f2/77a6379ea5154e7086d82a14afe8d29b 2023-02-18 03:01:24,155 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/74826de4ac49436ebce6231c3278b417, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:24,156 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f1/c0aee311b3694472bbf95b0f385876c6 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/c0aee311b3694472bbf95b0f385876c6 2023-02-18 03:01:24,156 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 33c551dba25200da53583bfdaa8f761c in 129ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,156 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:24,156 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:24,157 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:24,157 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 03:01:24,157 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. started... 2023-02-18 03:01:24,157 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f5dc414d3d4cb7f8063614acb97e1846 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-18 03:01:24,159 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f1/998ebd3e99744f1485e543b4296bfb3d as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/998ebd3e99744f1485e543b4296bfb3d 2023-02-18 03:01:24,162 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/121a0b54be934cf399e4db47003f3913, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,162 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f1/28bb6013ccee4f31a19a8dd39aec11bb as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/28bb6013ccee4f31a19a8dd39aec11bb 2023-02-18 03:01:24,163 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/.tmp/f2/71c9508b78764e678749d700c5291852 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/71c9508b78764e678749d700c5291852 2023-02-18 03:01:24,165 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/998ebd3e99744f1485e543b4296bfb3d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,165 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/c0aee311b3694472bbf95b0f385876c6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,166 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/.tmp/f2/2e683498a7204136ae57e31b79a1f2c9 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/2e683498a7204136ae57e31b79a1f2c9 2023-02-18 03:01:24,166 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/.tmp/f2/1eb8c775d7974df6acb1a6be5a02d7a1 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/1eb8c775d7974df6acb1a6be5a02d7a1 2023-02-18 03:01:24,168 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/71c9508b78764e678749d700c5291852, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,169 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8f222a0b965d27bee2ca86ee76c6d541 in 143ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,169 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:24,169 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:24,171 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,171 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-18 03:01:24,171 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. started... 2023-02-18 03:01:24,171 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 78d5c9bb5537a60ed3978037c58afef9 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-18 03:01:24,173 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/28bb6013ccee4f31a19a8dd39aec11bb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,174 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/.tmp/f2/77a6379ea5154e7086d82a14afe8d29b as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/77a6379ea5154e7086d82a14afe8d29b 2023-02-18 03:01:24,181 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/2e683498a7204136ae57e31b79a1f2c9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,181 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/1eb8c775d7974df6acb1a6be5a02d7a1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,182 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 35946dbf681d5e4e055dfff4415006a2 in 148ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,182 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 180ceaed53360deb602f0fcabd1853ac in 132ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,183 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:24,183 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:24,183 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:24,183 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:24,183 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 03:01:24,183 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-18 03:01:24,191 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f1/b4babb572fec45c9bb772779fa662fbe 2023-02-18 03:01:24,193 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/77a6379ea5154e7086d82a14afe8d29b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,194 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d2d86507c1adce9ee2eac21b9f97e5bc in 143ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,194 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:24,194 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:24,194 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 03:01:24,204 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f1/cb34c017d0454dcba24fa850ef7dddc3 2023-02-18 03:01:24,211 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f2/6b8490c8f00e4e88b12e52f6e93e30e2 2023-02-18 03:01:24,216 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f1/b4babb572fec45c9bb772779fa662fbe as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/b4babb572fec45c9bb772779fa662fbe 2023-02-18 03:01:24,221 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/b4babb572fec45c9bb772779fa662fbe, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,222 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/.tmp/f2/6b8490c8f00e4e88b12e52f6e93e30e2 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/6b8490c8f00e4e88b12e52f6e93e30e2 2023-02-18 03:01:24,234 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/6b8490c8f00e4e88b12e52f6e93e30e2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,235 INFO [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f5dc414d3d4cb7f8063614acb97e1846 in 78ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,235 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:24,235 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f2/6b98b486d2f64a29b7cbaa6f31e6f5c5 2023-02-18 03:01:24,235 DEBUG [rs(jenkins-hbase20.apache.org,35897,1676689280933)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:24,236 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 03:01:24,236 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 03:01:24,236 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,236 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 03:01:24,236 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35897,1676689280933' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 03:01:24,237 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,237 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:24,237 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,237 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:24,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:24,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35897,1676689280933' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 03:01:24,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4540da1d[Count = 1] remaining members to acquire global barrier 2023-02-18 03:01:24,240 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f1/cb34c017d0454dcba24fa850ef7dddc3 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/cb34c017d0454dcba24fa850ef7dddc3 2023-02-18 03:01:24,244 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/cb34c017d0454dcba24fa850ef7dddc3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:24,244 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/.tmp/f2/6b98b486d2f64a29b7cbaa6f31e6f5c5 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/6b98b486d2f64a29b7cbaa6f31e6f5c5 2023-02-18 03:01:24,249 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/6b98b486d2f64a29b7cbaa6f31e6f5c5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-18 03:01:24,250 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 78d5c9bb5537a60ed3978037c58afef9 in 79ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,250 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:24,250 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,250 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-18 03:01:24,530 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 03:01:24,537 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f2/39bdcdbe48e94cc3af3aa2084d677e67 2023-02-18 03:01:24,545 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f1/b3931ec8305c43b09fae00fe745d146d as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/b3931ec8305c43b09fae00fe745d146d 2023-02-18 03:01:24,553 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/b3931ec8305c43b09fae00fe745d146d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,554 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/.tmp/f2/39bdcdbe48e94cc3af3aa2084d677e67 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/39bdcdbe48e94cc3af3aa2084d677e67 2023-02-18 03:01:24,558 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/39bdcdbe48e94cc3af3aa2084d677e67, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-18 03:01:24,558 INFO [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1e26c03cb05d9f1d560ced340dc6c193 in 524ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:24,559 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:24,559 DEBUG [rs(jenkins-hbase20.apache.org,41379,1676689280886)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:24,559 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-18 03:01:24,559 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-18 03:01:24,559 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,559 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-18 03:01:24,559 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41379,1676689280886' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-18 03:01:24,560 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,560 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:24,561 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,561 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:24,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41379,1676689280886' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-18 03:01:24,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4540da1d[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:24,562 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-18 03:01:24,562 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,563 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 03:01:24,563 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-18 03:01:24,563 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 03:01:24,563 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-18 03:01:24,563 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,41379,1676689280886' in zk 2023-02-18 03:01:24,563 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,563 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase20.apache.org,35897,1676689280933' in zk 2023-02-18 03:01:24,563 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,563 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:24,564 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 03:01:24,564 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,564 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:24,564 DEBUG [member: 'jenkins-hbase20.apache.org,41379,1676689280886' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 03:01:24,564 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-18 03:01:24,565 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,565 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:24,565 DEBUG [member: 'jenkins-hbase20.apache.org,35897,1676689280933' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-18 03:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,41379,1676689280886': 2023-02-18 03:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41379,1676689280886' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-18 03:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:24,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase20.apache.org,35897,1676689280933': 2023-02-18 03:01:24,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35897,1676689280933' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-18 03:01:24,570 INFO [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-18 03:01:24,570 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:24,570 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:24,570 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,570 INFO [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:24,579 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:24,579 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:24,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:24,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:24,580 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,580 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:24,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,581 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,582 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,587 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:24,587 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:24,587 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:24,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:24,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-18 03:01:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:24,587 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:24,588 DEBUG [(jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:24,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:24,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:24,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:24,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:24,588 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,589 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,689 DEBUG [Listener at localhost.localdomain/39041] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:24,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:24,697 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676689282788 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:24,697 DEBUG [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(239): region to add: 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=55b565f7e665373341fd12e7280a7e8e as 55b565f7e665373341fd12e7280a7e8e in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=33c551dba25200da53583bfdaa8f761c as 33c551dba25200da53583bfdaa8f761c in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,698 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=4d32f9f2bb0be8c8c857dafb4d29282b as 4d32f9f2bb0be8c8c857dafb4d29282b in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=8f222a0b965d27bee2ca86ee76c6d541 as 8f222a0b965d27bee2ca86ee76c6d541 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=d2d86507c1adce9ee2eac21b9f97e5bc as d2d86507c1adce9ee2eac21b9f97e5bc in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=35946dbf681d5e4e055dfff4415006a2 as 35946dbf681d5e4e055dfff4415006a2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=1e26c03cb05d9f1d560ced340dc6c193 as 1e26c03cb05d9f1d560ced340dc6c193 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=180ceaed53360deb602f0fcabd1853ac as 180ceaed53360deb602f0fcabd1853ac in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=f5dc414d3d4cb7f8063614acb97e1846 as f5dc414d3d4cb7f8063614acb97e1846 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,699 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(585): clone region=78d5c9bb5537a60ed3978037c58afef9 as 78d5c9bb5537a60ed3978037c58afef9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,703 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 33c551dba25200da53583bfdaa8f761c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,703 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 55b565f7e665373341fd12e7280a7e8e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,707 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4d32f9f2bb0be8c8c857dafb4d29282b, NAME => 'testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,712 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 35946dbf681d5e4e055dfff4415006a2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,712 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d2d86507c1adce9ee2eac21b9f97e5bc, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,712 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 8f222a0b965d27bee2ca86ee76c6d541, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,712 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 1e26c03cb05d9f1d560ced340dc6c193, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,714 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 180ceaed53360deb602f0fcabd1853ac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,747 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 48617e529a0a4584971b9c61ef6528a7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 55b565f7e665373341fd12e7280a7e8e, disabling compactions & flushes 2023-02-18 03:01:24,766 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:24,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:24,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. after waiting 0 ms 2023-02-18 03:01:24,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:24,766 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:24,766 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:24,767 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5dc414d3d4cb7f8063614acb97e1846, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,767 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8c4a7be9970944b1a54320bcbe3cd4d6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,824 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 33c551dba25200da53583bfdaa8f761c, disabling compactions & flushes 2023-02-18 03:01:24,824 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6a3831b6c03a4c48a55cba720999916a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,824 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:24,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:24,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. after waiting 0 ms 2023-02-18 03:01:24,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:24,824 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:24,824 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:24,825 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 78d5c9bb5537a60ed3978037c58afef9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,840 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,840 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fe757a5146434772a4b74f237c4b9f80 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,845 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,845 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 4d32f9f2bb0be8c8c857dafb4d29282b, disabling compactions & flushes 2023-02-18 03:01:24,845 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:24,845 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:24,845 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. after waiting 0 ms 2023-02-18 03:01:24,846 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:24,846 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:24,846 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:24,847 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,847 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d52ecd4a48a048568be586c94668df0b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,847 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,847 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60764949b3584e7d93cbb6091d4e8f25 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,847 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,848 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c04702413d384823acfc213db6038c37 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,848 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 18e2577b6ac44811bc71e063af97c31d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,848 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bb94b60308b14639bffd88091f0da1b8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,856 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3f7db4b011224bb1bdcbd1f0d8d8db07 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,856 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 92f14351bef94f599c6227e8598fa0a0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,856 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 35946dbf681d5e4e055dfff4415006a2, disabling compactions & flushes 2023-02-18 03:01:24,856 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:24,856 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:24,856 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. after waiting 0 ms 2023-02-18 03:01:24,856 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:24,856 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:24,856 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:24,856 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 180ceaed53360deb602f0fcabd1853ac, disabling compactions & flushes 2023-02-18 03:01:24,857 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:24,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:24,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. after waiting 0 ms 2023-02-18 03:01:24,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:24,857 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:24,857 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:24,857 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 31a3db7b44b543da9fd0c17d63db0efd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 1e26c03cb05d9f1d560ced340dc6c193, disabling compactions & flushes 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d2d86507c1adce9ee2eac21b9f97e5bc, disabling compactions & flushes 2023-02-18 03:01:24,867 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dcb3cbfe4260421b9265ebd07729b7e4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,867 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:24,867 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. after waiting 0 ms 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. after waiting 0 ms 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:24,867 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:24,867 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:24,867 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:24,871 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:24,871 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 63e964091d884b2da3aa744345ce6cc6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,871 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 8f222a0b965d27bee2ca86ee76c6d541, disabling compactions & flushes 2023-02-18 03:01:24,871 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ae20ef37ec734907adb26bc0eeb16cd4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,871 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:24,871 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:24,871 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. after waiting 0 ms 2023-02-18 03:01:24,872 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:24,872 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:24,872 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:24,873 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5dc16e992cae4e86a6e5ac9ceb4ea788 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:24,873 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f5dc414d3d4cb7f8063614acb97e1846, disabling compactions & flushes 2023-02-18 03:01:24,873 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:24,873 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:24,874 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. after waiting 0 ms 2023-02-18 03:01:24,874 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:24,874 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:24,874 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:24,876 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 78d5c9bb5537a60ed3978037c58afef9, disabling compactions & flushes 2023-02-18 03:01:24,876 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,876 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,877 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. after waiting 1 ms 2023-02-18 03:01:24,877 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,877 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:24,877 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:24,877 INFO [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676689282788 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:24,877 DEBUG [Listener at localhost.localdomain/39041] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,877 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0 2023-02-18 03:01:24,878 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:24,879 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:24,879 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-18 03:01:24,880 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------180ceaed53360deb602f0fcabd1853ac/ 2023-02-18 03:01:24,880 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,881 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,881 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=180ceaed53360deb602f0fcabd1853ac-6a3831b6c03a4c48a55cba720999916a 2023-02-18 03:01:24,881 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,882 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=180ceaed53360deb602f0fcabd1853ac-c04702413d384823acfc213db6038c37 2023-02-18 03:01:24,882 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------1e26c03cb05d9f1d560ced340dc6c193/ 2023-02-18 03:01:24,882 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,882 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,882 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1e26c03cb05d9f1d560ced340dc6c193-18e2577b6ac44811bc71e063af97c31d 2023-02-18 03:01:24,882 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,883 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1e26c03cb05d9f1d560ced340dc6c193-3f7db4b011224bb1bdcbd1f0d8d8db07 2023-02-18 03:01:24,883 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------33c551dba25200da53583bfdaa8f761c/ 2023-02-18 03:01:24,883 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,883 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,884 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=33c551dba25200da53583bfdaa8f761c-48617e529a0a4584971b9c61ef6528a7 2023-02-18 03:01:24,884 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,884 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=33c551dba25200da53583bfdaa8f761c-8c4a7be9970944b1a54320bcbe3cd4d6 2023-02-18 03:01:24,884 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------35946dbf681d5e4e055dfff4415006a2/ 2023-02-18 03:01:24,884 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,884 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,885 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=35946dbf681d5e4e055dfff4415006a2-fe757a5146434772a4b74f237c4b9f80 2023-02-18 03:01:24,885 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,885 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=35946dbf681d5e4e055dfff4415006a2-bb94b60308b14639bffd88091f0da1b8 2023-02-18 03:01:24,885 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------4d32f9f2bb0be8c8c857dafb4d29282b/ 2023-02-18 03:01:24,885 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,885 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------55b565f7e665373341fd12e7280a7e8e/ 2023-02-18 03:01:24,886 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,886 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------78d5c9bb5537a60ed3978037c58afef9/ 2023-02-18 03:01:24,886 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,886 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,886 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=78d5c9bb5537a60ed3978037c58afef9-63e964091d884b2da3aa744345ce6cc6 2023-02-18 03:01:24,886 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,887 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=78d5c9bb5537a60ed3978037c58afef9-5dc16e992cae4e86a6e5ac9ceb4ea788 2023-02-18 03:01:24,887 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------8f222a0b965d27bee2ca86ee76c6d541/ 2023-02-18 03:01:24,887 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,887 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,887 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8f222a0b965d27bee2ca86ee76c6d541-d52ecd4a48a048568be586c94668df0b 2023-02-18 03:01:24,887 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,888 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8f222a0b965d27bee2ca86ee76c6d541-31a3db7b44b543da9fd0c17d63db0efd 2023-02-18 03:01:24,888 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------d2d86507c1adce9ee2eac21b9f97e5bc/ 2023-02-18 03:01:24,888 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,888 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d2d86507c1adce9ee2eac21b9f97e5bc-60764949b3584e7d93cbb6091d4e8f25 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d2d86507c1adce9ee2eac21b9f97e5bc-92f14351bef94f599c6227e8598fa0a0 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |----------f5dc414d3d4cb7f8063614acb97e1846/ 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f5dc414d3d4cb7f8063614acb97e1846-dcb3cbfe4260421b9265ebd07729b7e4 2023-02-18 03:01:24,889 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:24,890 DEBUG [Listener at localhost.localdomain/39041] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f5dc414d3d4cb7f8063614acb97e1846-ae20ef37ec734907adb26bc0eeb16cd4 2023-02-18 03:01:24,893 INFO [Listener at localhost.localdomain/39041] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 03:01:25,344 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,344 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,345 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,348 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:25,349 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1 2023-02-18 03:01:25,349 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 180ceaed53360deb602f0fcabd1853ac columnFamilyName f1 2023-02-18 03:01:25,354 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/testWithMockedMapReduceMultiRegion=180ceaed53360deb602f0fcabd1853ac-6a3831b6c03a4c48a55cba720999916a 2023-02-18 03:01:25,354 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(310): Store=180ceaed53360deb602f0fcabd1853ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,354 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:25,355 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2 2023-02-18 03:01:25,355 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 180ceaed53360deb602f0fcabd1853ac columnFamilyName f2 2023-02-18 03:01:25,360 DEBUG [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/testWithMockedMapReduceMultiRegion=180ceaed53360deb602f0fcabd1853ac-c04702413d384823acfc213db6038c37 2023-02-18 03:01:25,361 INFO [StoreOpener-180ceaed53360deb602f0fcabd1853ac-1] regionserver.HStore(310): Store=180ceaed53360deb602f0fcabd1853ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,361 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,361 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 180ceaed53360deb602f0fcabd1853ac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71877757, jitterRate=0.07106204330921173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,361 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:25,389 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 180ceaed53360deb602f0fcabd1853ac, disabling compactions & flushes 2023-02-18 03:01:25,391 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,391 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,391 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. after waiting 0 ms 2023-02-18 03:01:25,391 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,392 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,392 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:25,392 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,392 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,395 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,397 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:25,397 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1 2023-02-18 03:01:25,398 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e26c03cb05d9f1d560ced340dc6c193 columnFamilyName f1 2023-02-18 03:01:25,402 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/testWithMockedMapReduceMultiRegion=1e26c03cb05d9f1d560ced340dc6c193-18e2577b6ac44811bc71e063af97c31d 2023-02-18 03:01:25,402 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(310): Store=1e26c03cb05d9f1d560ced340dc6c193/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,402 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:25,403 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2 2023-02-18 03:01:25,403 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e26c03cb05d9f1d560ced340dc6c193 columnFamilyName f2 2023-02-18 03:01:25,409 DEBUG [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/testWithMockedMapReduceMultiRegion=1e26c03cb05d9f1d560ced340dc6c193-3f7db4b011224bb1bdcbd1f0d8d8db07 2023-02-18 03:01:25,409 INFO [StoreOpener-1e26c03cb05d9f1d560ced340dc6c193-1] regionserver.HStore(310): Store=1e26c03cb05d9f1d560ced340dc6c193/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,409 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,409 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 1e26c03cb05d9f1d560ced340dc6c193; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66328404, jitterRate=-0.011629760265350342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,409 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:25,419 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 1e26c03cb05d9f1d560ced340dc6c193, disabling compactions & flushes 2023-02-18 03:01:25,419 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,419 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,420 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. after waiting 0 ms 2023-02-18 03:01:25,420 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,422 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,422 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:25,423 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,423 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,424 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,426 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:25,427 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1 2023-02-18 03:01:25,427 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35946dbf681d5e4e055dfff4415006a2 columnFamilyName f1 2023-02-18 03:01:25,432 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/testWithMockedMapReduceMultiRegion=35946dbf681d5e4e055dfff4415006a2-fe757a5146434772a4b74f237c4b9f80 2023-02-18 03:01:25,433 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(310): Store=35946dbf681d5e4e055dfff4415006a2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,433 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:25,434 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2 2023-02-18 03:01:25,434 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35946dbf681d5e4e055dfff4415006a2 columnFamilyName f2 2023-02-18 03:01:25,439 DEBUG [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/testWithMockedMapReduceMultiRegion=35946dbf681d5e4e055dfff4415006a2-bb94b60308b14639bffd88091f0da1b8 2023-02-18 03:01:25,439 INFO [StoreOpener-35946dbf681d5e4e055dfff4415006a2-1] regionserver.HStore(310): Store=35946dbf681d5e4e055dfff4415006a2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,439 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,439 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 35946dbf681d5e4e055dfff4415006a2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72756380, jitterRate=0.08415454626083374}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,439 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:25,451 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 35946dbf681d5e4e055dfff4415006a2, disabling compactions & flushes 2023-02-18 03:01:25,451 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,451 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,451 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. after waiting 0 ms 2023-02-18 03:01:25,451 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,452 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,452 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:25,453 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,453 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,455 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,457 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:25,458 DEBUG [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f1 2023-02-18 03:01:25,458 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55b565f7e665373341fd12e7280a7e8e columnFamilyName f1 2023-02-18 03:01:25,458 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(310): Store=55b565f7e665373341fd12e7280a7e8e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,459 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:25,460 DEBUG [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f2 2023-02-18 03:01:25,460 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 55b565f7e665373341fd12e7280a7e8e columnFamilyName f2 2023-02-18 03:01:25,460 INFO [StoreOpener-55b565f7e665373341fd12e7280a7e8e-1] regionserver.HStore(310): Store=55b565f7e665373341fd12e7280a7e8e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,461 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 55b565f7e665373341fd12e7280a7e8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59422999, jitterRate=-0.11452831327915192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 55b565f7e665373341fd12e7280a7e8e, disabling compactions & flushes 2023-02-18 03:01:25,461 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. after waiting 0 ms 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,461 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,461 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:25,462 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,462 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,464 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,466 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:25,467 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1 2023-02-18 03:01:25,467 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33c551dba25200da53583bfdaa8f761c columnFamilyName f1 2023-02-18 03:01:25,470 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/testWithMockedMapReduceMultiRegion=33c551dba25200da53583bfdaa8f761c-48617e529a0a4584971b9c61ef6528a7 2023-02-18 03:01:25,471 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(310): Store=33c551dba25200da53583bfdaa8f761c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,471 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:25,472 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2 2023-02-18 03:01:25,472 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33c551dba25200da53583bfdaa8f761c columnFamilyName f2 2023-02-18 03:01:25,476 DEBUG [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/testWithMockedMapReduceMultiRegion=33c551dba25200da53583bfdaa8f761c-8c4a7be9970944b1a54320bcbe3cd4d6 2023-02-18 03:01:25,476 INFO [StoreOpener-33c551dba25200da53583bfdaa8f761c-1] regionserver.HStore(310): Store=33c551dba25200da53583bfdaa8f761c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,476 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,476 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 33c551dba25200da53583bfdaa8f761c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60012980, jitterRate=-0.10573691129684448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,476 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:25,486 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 33c551dba25200da53583bfdaa8f761c, disabling compactions & flushes 2023-02-18 03:01:25,487 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,487 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,487 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. after waiting 0 ms 2023-02-18 03:01:25,487 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,487 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,487 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:25,488 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,488 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,489 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,491 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:25,492 DEBUG [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f1 2023-02-18 03:01:25,492 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d32f9f2bb0be8c8c857dafb4d29282b columnFamilyName f1 2023-02-18 03:01:25,492 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(310): Store=4d32f9f2bb0be8c8c857dafb4d29282b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,492 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:25,493 DEBUG [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f2 2023-02-18 03:01:25,493 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d32f9f2bb0be8c8c857dafb4d29282b columnFamilyName f2 2023-02-18 03:01:25,494 INFO [StoreOpener-4d32f9f2bb0be8c8c857dafb4d29282b-1] regionserver.HStore(310): Store=4d32f9f2bb0be8c8c857dafb4d29282b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,494 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,494 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 4d32f9f2bb0be8c8c857dafb4d29282b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71576446, jitterRate=0.0665721595287323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,494 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:25,494 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 4d32f9f2bb0be8c8c857dafb4d29282b, disabling compactions & flushes 2023-02-18 03:01:25,494 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,494 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,494 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. after waiting 0 ms 2023-02-18 03:01:25,494 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,494 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,495 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:25,495 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,495 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,496 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,498 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:25,498 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1 2023-02-18 03:01:25,498 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78d5c9bb5537a60ed3978037c58afef9 columnFamilyName f1 2023-02-18 03:01:25,502 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/testWithMockedMapReduceMultiRegion=78d5c9bb5537a60ed3978037c58afef9-63e964091d884b2da3aa744345ce6cc6 2023-02-18 03:01:25,502 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(310): Store=78d5c9bb5537a60ed3978037c58afef9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,502 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:25,503 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2 2023-02-18 03:01:25,503 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78d5c9bb5537a60ed3978037c58afef9 columnFamilyName f2 2023-02-18 03:01:25,507 DEBUG [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/testWithMockedMapReduceMultiRegion=78d5c9bb5537a60ed3978037c58afef9-5dc16e992cae4e86a6e5ac9ceb4ea788 2023-02-18 03:01:25,507 INFO [StoreOpener-78d5c9bb5537a60ed3978037c58afef9-1] regionserver.HStore(310): Store=78d5c9bb5537a60ed3978037c58afef9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,508 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,508 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 78d5c9bb5537a60ed3978037c58afef9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63814026, jitterRate=-0.049096912145614624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,508 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:25,518 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 78d5c9bb5537a60ed3978037c58afef9, disabling compactions & flushes 2023-02-18 03:01:25,518 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,518 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,518 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. after waiting 0 ms 2023-02-18 03:01:25,518 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,519 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,519 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:25,519 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,520 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,521 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,523 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:25,523 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1 2023-02-18 03:01:25,524 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5dc414d3d4cb7f8063614acb97e1846 columnFamilyName f1 2023-02-18 03:01:25,527 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/testWithMockedMapReduceMultiRegion=f5dc414d3d4cb7f8063614acb97e1846-dcb3cbfe4260421b9265ebd07729b7e4 2023-02-18 03:01:25,528 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(310): Store=f5dc414d3d4cb7f8063614acb97e1846/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,528 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:25,529 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2 2023-02-18 03:01:25,529 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5dc414d3d4cb7f8063614acb97e1846 columnFamilyName f2 2023-02-18 03:01:25,532 DEBUG [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/testWithMockedMapReduceMultiRegion=f5dc414d3d4cb7f8063614acb97e1846-ae20ef37ec734907adb26bc0eeb16cd4 2023-02-18 03:01:25,533 INFO [StoreOpener-f5dc414d3d4cb7f8063614acb97e1846-1] regionserver.HStore(310): Store=f5dc414d3d4cb7f8063614acb97e1846/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,533 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,533 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened f5dc414d3d4cb7f8063614acb97e1846; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64765905, jitterRate=-0.03491280972957611}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,533 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:25,540 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing f5dc414d3d4cb7f8063614acb97e1846, disabling compactions & flushes 2023-02-18 03:01:25,541 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,541 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,541 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. after waiting 0 ms 2023-02-18 03:01:25,541 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,541 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,541 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:25,542 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,542 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,543 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,544 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:25,545 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1 2023-02-18 03:01:25,545 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f222a0b965d27bee2ca86ee76c6d541 columnFamilyName f1 2023-02-18 03:01:25,549 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/testWithMockedMapReduceMultiRegion=8f222a0b965d27bee2ca86ee76c6d541-d52ecd4a48a048568be586c94668df0b 2023-02-18 03:01:25,549 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(310): Store=8f222a0b965d27bee2ca86ee76c6d541/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,549 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:25,550 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2 2023-02-18 03:01:25,550 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f222a0b965d27bee2ca86ee76c6d541 columnFamilyName f2 2023-02-18 03:01:25,555 DEBUG [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/testWithMockedMapReduceMultiRegion=8f222a0b965d27bee2ca86ee76c6d541-31a3db7b44b543da9fd0c17d63db0efd 2023-02-18 03:01:25,555 INFO [StoreOpener-8f222a0b965d27bee2ca86ee76c6d541-1] regionserver.HStore(310): Store=8f222a0b965d27bee2ca86ee76c6d541/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,555 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,555 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened 8f222a0b965d27bee2ca86ee76c6d541; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64758268, jitterRate=-0.035026609897613525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,555 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:25,563 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing 8f222a0b965d27bee2ca86ee76c6d541, disabling compactions & flushes 2023-02-18 03:01:25,563 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,564 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,564 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. after waiting 0 ms 2023-02-18 03:01:25,564 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,564 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,565 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:25,565 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:25,565 INFO [Listener at localhost.localdomain/39041] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:25,567 DEBUG [Listener at localhost.localdomain/39041] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:25,569 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:25,570 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1 2023-02-18 03:01:25,570 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d86507c1adce9ee2eac21b9f97e5bc columnFamilyName f1 2023-02-18 03:01:25,574 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/testWithMockedMapReduceMultiRegion=d2d86507c1adce9ee2eac21b9f97e5bc-60764949b3584e7d93cbb6091d4e8f25 2023-02-18 03:01:25,575 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(310): Store=d2d86507c1adce9ee2eac21b9f97e5bc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,575 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:25,576 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2 2023-02-18 03:01:25,576 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2d86507c1adce9ee2eac21b9f97e5bc columnFamilyName f2 2023-02-18 03:01:25,580 DEBUG [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:34243/user/jenkins/test-data/0af6ab1b-8105-abd7-0f85-01e5563e03ba/testWithMockedMapReduceMultiRegion/03fc555e-1601-44c7-87ad-1213ddbb8eb0/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/testWithMockedMapReduceMultiRegion=d2d86507c1adce9ee2eac21b9f97e5bc-92f14351bef94f599c6227e8598fa0a0 2023-02-18 03:01:25,580 INFO [StoreOpener-d2d86507c1adce9ee2eac21b9f97e5bc-1] regionserver.HStore(310): Store=d2d86507c1adce9ee2eac21b9f97e5bc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:25,580 DEBUG [Listener at localhost.localdomain/39041] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:25,581 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1071): Opened d2d86507c1adce9ee2eac21b9f97e5bc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71726938, jitterRate=0.06881466507911682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:25,581 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(964): Region open journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:25,592 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1603): Closing d2d86507c1adce9ee2eac21b9f97e5bc, disabling compactions & flushes 2023-02-18 03:01:25,592 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,592 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,592 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. after waiting 0 ms 2023-02-18 03:01:25,592 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,593 INFO [Listener at localhost.localdomain/39041] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,593 DEBUG [Listener at localhost.localdomain/39041] regionserver.HRegion(1557): Region close journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:25,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-18 03:01:25,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,604 INFO [Listener at localhost.localdomain/39041] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,608 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689285608"}]},"ts":"1676689285608"} 2023-02-18 03:01:25,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:25,609 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-18 03:01:25,610 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-18 03:01:25,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, UNASSIGN}] 2023-02-18 03:01:25,613 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, UNASSIGN 2023-02-18 03:01:25,614 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, UNASSIGN 2023-02-18 03:01:25,614 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, UNASSIGN 2023-02-18 03:01:25,614 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, UNASSIGN 2023-02-18 03:01:25,614 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, UNASSIGN 2023-02-18 03:01:25,615 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=4d32f9f2bb0be8c8c857dafb4d29282b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:25,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1e26c03cb05d9f1d560ced340dc6c193, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:25,615 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=55b565f7e665373341fd12e7280a7e8e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:25,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285615"}]},"ts":"1676689285615"} 2023-02-18 03:01:25,615 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689285615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285615"}]},"ts":"1676689285615"} 2023-02-18 03:01:25,615 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689285615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285615"}]},"ts":"1676689285615"} 2023-02-18 03:01:25,615 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=33c551dba25200da53583bfdaa8f761c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:25,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285615"}]},"ts":"1676689285615"} 2023-02-18 03:01:25,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=78d5c9bb5537a60ed3978037c58afef9, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:25,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285616"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285616"}]},"ts":"1676689285616"} 2023-02-18 03:01:25,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=34, state=RUNNABLE; CloseRegionProcedure 4d32f9f2bb0be8c8c857dafb4d29282b, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:25,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure 1e26c03cb05d9f1d560ced340dc6c193, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:25,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure 55b565f7e665373341fd12e7280a7e8e, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:25,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure 33c551dba25200da53583bfdaa8f761c, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:25,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=35, state=RUNNABLE; CloseRegionProcedure 78d5c9bb5537a60ed3978037c58afef9, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:25,621 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, UNASSIGN 2023-02-18 03:01:25,621 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, UNASSIGN 2023-02-18 03:01:25,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f5dc414d3d4cb7f8063614acb97e1846, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:25,622 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285621"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285621"}]},"ts":"1676689285621"} 2023-02-18 03:01:25,622 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, UNASSIGN 2023-02-18 03:01:25,622 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d2d86507c1adce9ee2eac21b9f97e5bc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:25,623 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, UNASSIGN 2023-02-18 03:01:25,623 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285622"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285622"}]},"ts":"1676689285622"} 2023-02-18 03:01:25,623 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, UNASSIGN 2023-02-18 03:01:25,623 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8f222a0b965d27bee2ca86ee76c6d541, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:25,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=35946dbf681d5e4e055dfff4415006a2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:25,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285624"}]},"ts":"1676689285624"} 2023-02-18 03:01:25,624 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285623"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285623"}]},"ts":"1676689285623"} 2023-02-18 03:01:25,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=40, state=RUNNABLE; CloseRegionProcedure f5dc414d3d4cb7f8063614acb97e1846, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:25,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=39, state=RUNNABLE; CloseRegionProcedure d2d86507c1adce9ee2eac21b9f97e5bc, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:25,625 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=180ceaed53360deb602f0fcabd1853ac, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:25,625 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285625"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689285625"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689285625"}]},"ts":"1676689285625"} 2023-02-18 03:01:25,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=37, state=RUNNABLE; CloseRegionProcedure 35946dbf681d5e4e055dfff4415006a2, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:25,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=38, state=RUNNABLE; CloseRegionProcedure 8f222a0b965d27bee2ca86ee76c6d541, server=jenkins-hbase20.apache.org,41379,1676689280886}] 2023-02-18 03:01:25,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure 180ceaed53360deb602f0fcabd1853ac, server=jenkins-hbase20.apache.org,35897,1676689280933}] 2023-02-18 03:01:25,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:25,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:25,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing f5dc414d3d4cb7f8063614acb97e1846, disabling compactions & flushes 2023-02-18 03:01:25,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. after waiting 0 ms 2023-02-18 03:01:25,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:25,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 55b565f7e665373341fd12e7280a7e8e, disabling compactions & flushes 2023-02-18 03:01:25,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. after waiting 0 ms 2023-02-18 03:01:25,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 03:01:25,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e. 2023-02-18 03:01:25,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846. 2023-02-18 03:01:25,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 55b565f7e665373341fd12e7280a7e8e: 2023-02-18 03:01:25,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for f5dc414d3d4cb7f8063614acb97e1846: 2023-02-18 03:01:25,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:25,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:25,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 78d5c9bb5537a60ed3978037c58afef9, disabling compactions & flushes 2023-02-18 03:01:25,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. after waiting 0 ms 2023-02-18 03:01:25,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,777 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=55b565f7e665373341fd12e7280a7e8e, regionState=CLOSED 2023-02-18 03:01:25,778 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689285777"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285777"}]},"ts":"1676689285777"} 2023-02-18 03:01:25,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:25,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:25,778 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=f5dc414d3d4cb7f8063614acb97e1846, regionState=CLOSED 2023-02-18 03:01:25,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 4d32f9f2bb0be8c8c857dafb4d29282b, disabling compactions & flushes 2023-02-18 03:01:25,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,778 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285778"}]},"ts":"1676689285778"} 2023-02-18 03:01:25,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. after waiting 0 ms 2023-02-18 03:01:25,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-18 03:01:25,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure 55b565f7e665373341fd12e7280a7e8e, server=jenkins-hbase20.apache.org,41379,1676689280886 in 161 msec 2023-02-18 03:01:25,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=40 2023-02-18 03:01:25,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=40, state=SUCCESS; CloseRegionProcedure f5dc414d3d4cb7f8063614acb97e1846, server=jenkins-hbase20.apache.org,35897,1676689280933 in 155 msec 2023-02-18 03:01:25,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=55b565f7e665373341fd12e7280a7e8e, UNASSIGN in 169 msec 2023-02-18 03:01:25,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-18 03:01:25,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f5dc414d3d4cb7f8063614acb97e1846, UNASSIGN in 170 msec 2023-02-18 03:01:25,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9. 2023-02-18 03:01:25,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b. 2023-02-18 03:01:25,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 78d5c9bb5537a60ed3978037c58afef9: 2023-02-18 03:01:25,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 4d32f9f2bb0be8c8c857dafb4d29282b: 2023-02-18 03:01:25,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:25,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 180ceaed53360deb602f0fcabd1853ac, disabling compactions & flushes 2023-02-18 03:01:25,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. after waiting 0 ms 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,785 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=4d32f9f2bb0be8c8c857dafb4d29282b, regionState=CLOSED 2023-02-18 03:01:25,785 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676689285785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285785"}]},"ts":"1676689285785"} 2023-02-18 03:01:25,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:25,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 35946dbf681d5e4e055dfff4415006a2, disabling compactions & flushes 2023-02-18 03:01:25,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. after waiting 0 ms 2023-02-18 03:01:25,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=78d5c9bb5537a60ed3978037c58afef9, regionState=CLOSED 2023-02-18 03:01:25,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285785"}]},"ts":"1676689285785"} 2023-02-18 03:01:25,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=34 2023-02-18 03:01:25,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=34, state=SUCCESS; CloseRegionProcedure 4d32f9f2bb0be8c8c857dafb4d29282b, server=jenkins-hbase20.apache.org,35897,1676689280933 in 169 msec 2023-02-18 03:01:25,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=35 2023-02-18 03:01:25,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=35, state=SUCCESS; CloseRegionProcedure 78d5c9bb5537a60ed3978037c58afef9, server=jenkins-hbase20.apache.org,41379,1676689280886 in 167 msec 2023-02-18 03:01:25,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac. 2023-02-18 03:01:25,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 180ceaed53360deb602f0fcabd1853ac: 2023-02-18 03:01:25,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4d32f9f2bb0be8c8c857dafb4d29282b, UNASSIGN in 177 msec 2023-02-18 03:01:25,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=78d5c9bb5537a60ed3978037c58afef9, UNASSIGN in 178 msec 2023-02-18 03:01:25,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2. 2023-02-18 03:01:25,794 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 35946dbf681d5e4e055dfff4415006a2: 2023-02-18 03:01:25,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:25,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:25,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d2d86507c1adce9ee2eac21b9f97e5bc, disabling compactions & flushes 2023-02-18 03:01:25,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. after waiting 0 ms 2023-02-18 03:01:25,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,795 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=180ceaed53360deb602f0fcabd1853ac, regionState=CLOSED 2023-02-18 03:01:25,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285795"}]},"ts":"1676689285795"} 2023-02-18 03:01:25,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:25,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:25,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8f222a0b965d27bee2ca86ee76c6d541, disabling compactions & flushes 2023-02-18 03:01:25,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,796 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=35946dbf681d5e4e055dfff4415006a2, regionState=CLOSED 2023-02-18 03:01:25,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. after waiting 0 ms 2023-02-18 03:01:25,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,796 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285796"}]},"ts":"1676689285796"} 2023-02-18 03:01:25,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-18 03:01:25,798 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure 180ceaed53360deb602f0fcabd1853ac, server=jenkins-hbase20.apache.org,35897,1676689280933 in 165 msec 2023-02-18 03:01:25,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=37 2023-02-18 03:01:25,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=37, state=SUCCESS; CloseRegionProcedure 35946dbf681d5e4e055dfff4415006a2, server=jenkins-hbase20.apache.org,41379,1676689280886 in 171 msec 2023-02-18 03:01:25,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=180ceaed53360deb602f0fcabd1853ac, UNASSIGN in 187 msec 2023-02-18 03:01:25,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc. 2023-02-18 03:01:25,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d2d86507c1adce9ee2eac21b9f97e5bc: 2023-02-18 03:01:25,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=35946dbf681d5e4e055dfff4415006a2, UNASSIGN in 188 msec 2023-02-18 03:01:25,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541. 2023-02-18 03:01:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8f222a0b965d27bee2ca86ee76c6d541: 2023-02-18 03:01:25,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:25,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 33c551dba25200da53583bfdaa8f761c, disabling compactions & flushes 2023-02-18 03:01:25,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. after waiting 0 ms 2023-02-18 03:01:25,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,803 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=d2d86507c1adce9ee2eac21b9f97e5bc, regionState=CLOSED 2023-02-18 03:01:25,804 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285803"}]},"ts":"1676689285803"} 2023-02-18 03:01:25,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:25,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:25,804 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=8f222a0b965d27bee2ca86ee76c6d541, regionState=CLOSED 2023-02-18 03:01:25,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1e26c03cb05d9f1d560ced340dc6c193, disabling compactions & flushes 2023-02-18 03:01:25,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,805 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285804"}]},"ts":"1676689285804"} 2023-02-18 03:01:25,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. after waiting 0 ms 2023-02-18 03:01:25,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=39 2023-02-18 03:01:25,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=39, state=SUCCESS; CloseRegionProcedure d2d86507c1adce9ee2eac21b9f97e5bc, server=jenkins-hbase20.apache.org,35897,1676689280933 in 180 msec 2023-02-18 03:01:25,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=38 2023-02-18 03:01:25,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d2d86507c1adce9ee2eac21b9f97e5bc, UNASSIGN in 195 msec 2023-02-18 03:01:25,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=38, state=SUCCESS; CloseRegionProcedure 8f222a0b965d27bee2ca86ee76c6d541, server=jenkins-hbase20.apache.org,41379,1676689280886 in 179 msec 2023-02-18 03:01:25,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8f222a0b965d27bee2ca86ee76c6d541, UNASSIGN in 196 msec 2023-02-18 03:01:25,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c. 2023-02-18 03:01:25,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 33c551dba25200da53583bfdaa8f761c: 2023-02-18 03:01:25,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:25,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:25,811 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=33c551dba25200da53583bfdaa8f761c, regionState=CLOSED 2023-02-18 03:01:25,811 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285811"}]},"ts":"1676689285811"} 2023-02-18 03:01:25,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193. 2023-02-18 03:01:25,812 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1e26c03cb05d9f1d560ced340dc6c193: 2023-02-18 03:01:25,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:25,814 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=1e26c03cb05d9f1d560ced340dc6c193, regionState=CLOSED 2023-02-18 03:01:25,814 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676689285814"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689285814"}]},"ts":"1676689285814"} 2023-02-18 03:01:25,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-18 03:01:25,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure 33c551dba25200da53583bfdaa8f761c, server=jenkins-hbase20.apache.org,35897,1676689280933 in 195 msec 2023-02-18 03:01:25,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33c551dba25200da53583bfdaa8f761c, UNASSIGN in 204 msec 2023-02-18 03:01:25,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-18 03:01:25,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure 1e26c03cb05d9f1d560ced340dc6c193, server=jenkins-hbase20.apache.org,41379,1676689280886 in 197 msec 2023-02-18 03:01:25,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=33 2023-02-18 03:01:25,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1e26c03cb05d9f1d560ced340dc6c193, UNASSIGN in 205 msec 2023-02-18 03:01:25,817 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689285817"}]},"ts":"1676689285817"} 2023-02-18 03:01:25,818 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-18 03:01:25,819 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-18 03:01:25,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 215 msec 2023-02-18 03:01:25,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-18 03:01:25,912 INFO [Listener at localhost.localdomain/39041] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-18 03:01:25,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,916 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,917 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:25,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:25,927 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:25,930 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/recovered.edits] 2023-02-18 03:01:25,930 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/recovered.edits] 2023-02-18 03:01:25,931 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/recovered.edits] 2023-02-18 03:01:25,931 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/recovered.edits] 2023-02-18 03:01:25,931 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/recovered.edits] 2023-02-18 03:01:25,931 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/recovered.edits] 2023-02-18 03:01:25,931 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/recovered.edits] 2023-02-18 03:01:25,932 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/recovered.edits] 2023-02-18 03:01:25,936 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/121a0b54be934cf399e4db47003f3913 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/121a0b54be934cf399e4db47003f3913 2023-02-18 03:01:25,937 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/998ebd3e99744f1485e543b4296bfb3d to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/998ebd3e99744f1485e543b4296bfb3d 2023-02-18 03:01:25,937 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/b4babb572fec45c9bb772779fa662fbe to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/b4babb572fec45c9bb772779fa662fbe 2023-02-18 03:01:25,938 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/18e2577b6ac44811bc71e063af97c31d to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/18e2577b6ac44811bc71e063af97c31d 2023-02-18 03:01:25,938 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/28bb6013ccee4f31a19a8dd39aec11bb to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/28bb6013ccee4f31a19a8dd39aec11bb 2023-02-18 03:01:25,939 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/d52ecd4a48a048568be586c94668df0b to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f1/d52ecd4a48a048568be586c94668df0b 2023-02-18 03:01:25,940 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/63e964091d884b2da3aa744345ce6cc6 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/63e964091d884b2da3aa744345ce6cc6 2023-02-18 03:01:25,940 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/fe757a5146434772a4b74f237c4b9f80 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f1/fe757a5146434772a4b74f237c4b9f80 2023-02-18 03:01:25,940 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/6a3831b6c03a4c48a55cba720999916a to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/6a3831b6c03a4c48a55cba720999916a 2023-02-18 03:01:25,940 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/dcb3cbfe4260421b9265ebd07729b7e4 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f1/dcb3cbfe4260421b9265ebd07729b7e4 2023-02-18 03:01:25,942 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/b3931ec8305c43b09fae00fe745d146d to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f1/b3931ec8305c43b09fae00fe745d146d 2023-02-18 03:01:25,943 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/60764949b3584e7d93cbb6091d4e8f25 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f1/60764949b3584e7d93cbb6091d4e8f25 2023-02-18 03:01:25,943 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/c0aee311b3694472bbf95b0f385876c6 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f1/c0aee311b3694472bbf95b0f385876c6 2023-02-18 03:01:25,943 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/cb34c017d0454dcba24fa850ef7dddc3 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f1/cb34c017d0454dcba24fa850ef7dddc3 2023-02-18 03:01:25,943 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/recovered.edits/6.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b/recovered.edits/6.seqid 2023-02-18 03:01:25,944 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/4d32f9f2bb0be8c8c857dafb4d29282b 2023-02-18 03:01:25,944 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:25,945 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/6b8490c8f00e4e88b12e52f6e93e30e2 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/6b8490c8f00e4e88b12e52f6e93e30e2 2023-02-18 03:01:25,945 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/31a3db7b44b543da9fd0c17d63db0efd to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/31a3db7b44b543da9fd0c17d63db0efd 2023-02-18 03:01:25,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/2e683498a7204136ae57e31b79a1f2c9 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/2e683498a7204136ae57e31b79a1f2c9 2023-02-18 03:01:25,948 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/ae20ef37ec734907adb26bc0eeb16cd4 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/f2/ae20ef37ec734907adb26bc0eeb16cd4 2023-02-18 03:01:25,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/71c9508b78764e678749d700c5291852 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/f2/71c9508b78764e678749d700c5291852 2023-02-18 03:01:25,949 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/recovered.edits] 2023-02-18 03:01:25,950 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/39bdcdbe48e94cc3af3aa2084d677e67 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/39bdcdbe48e94cc3af3aa2084d677e67 2023-02-18 03:01:25,950 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/1eb8c775d7974df6acb1a6be5a02d7a1 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/1eb8c775d7974df6acb1a6be5a02d7a1 2023-02-18 03:01:25,950 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/77a6379ea5154e7086d82a14afe8d29b to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/77a6379ea5154e7086d82a14afe8d29b 2023-02-18 03:01:25,950 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/5dc16e992cae4e86a6e5ac9ceb4ea788 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/5dc16e992cae4e86a6e5ac9ceb4ea788 2023-02-18 03:01:25,951 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/bb94b60308b14639bffd88091f0da1b8 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/f2/bb94b60308b14639bffd88091f0da1b8 2023-02-18 03:01:25,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/3f7db4b011224bb1bdcbd1f0d8d8db07 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/f2/3f7db4b011224bb1bdcbd1f0d8d8db07 2023-02-18 03:01:25,962 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/92f14351bef94f599c6227e8598fa0a0 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/f2/92f14351bef94f599c6227e8598fa0a0 2023-02-18 03:01:25,962 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846/recovered.edits/12.seqid 2023-02-18 03:01:25,963 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/c04702413d384823acfc213db6038c37 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/f2/c04702413d384823acfc213db6038c37 2023-02-18 03:01:25,964 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/f5dc414d3d4cb7f8063614acb97e1846 2023-02-18 03:01:25,964 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:25,964 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/6b98b486d2f64a29b7cbaa6f31e6f5c5 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/f2/6b98b486d2f64a29b7cbaa6f31e6f5c5 2023-02-18 03:01:25,964 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541/recovered.edits/12.seqid 2023-02-18 03:01:25,965 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/8f222a0b965d27bee2ca86ee76c6d541 2023-02-18 03:01:25,967 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/48617e529a0a4584971b9c61ef6528a7 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/48617e529a0a4584971b9c61ef6528a7 2023-02-18 03:01:25,968 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f1, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/f2, FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/recovered.edits] 2023-02-18 03:01:25,968 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac/recovered.edits/12.seqid 2023-02-18 03:01:25,982 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2/recovered.edits/12.seqid 2023-02-18 03:01:25,982 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193/recovered.edits/12.seqid 2023-02-18 03:01:25,983 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/180ceaed53360deb602f0fcabd1853ac 2023-02-18 03:01:25,983 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc/recovered.edits/12.seqid 2023-02-18 03:01:25,983 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/8df94f0a593942318e9b62797ef38eb0 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f1/8df94f0a593942318e9b62797ef38eb0 2023-02-18 03:01:25,984 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/35946dbf681d5e4e055dfff4415006a2 2023-02-18 03:01:25,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/d2d86507c1adce9ee2eac21b9f97e5bc 2023-02-18 03:01:25,985 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/1e26c03cb05d9f1d560ced340dc6c193 2023-02-18 03:01:25,986 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9/recovered.edits/12.seqid 2023-02-18 03:01:25,987 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/78d5c9bb5537a60ed3978037c58afef9 2023-02-18 03:01:25,988 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/74826de4ac49436ebce6231c3278b417 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/74826de4ac49436ebce6231c3278b417 2023-02-18 03:01:25,990 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/8c4a7be9970944b1a54320bcbe3cd4d6 to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/f2/8c4a7be9970944b1a54320bcbe3cd4d6 2023-02-18 03:01:25,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/recovered.edits/6.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e/recovered.edits/6.seqid 2023-02-18 03:01:25,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/55b565f7e665373341fd12e7280a7e8e 2023-02-18 03:01:25,994 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/recovered.edits/12.seqid to hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/archive/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c/recovered.edits/12.seqid 2023-02-18 03:01:25,995 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/.tmp/data/default/testWithMockedMapReduceMultiRegion/33c551dba25200da53583bfdaa8f761c 2023-02-18 03:01:25,995 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-18 03:01:25,998 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:26,001 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-18 03:01:26,004 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,006 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689286006"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,009 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-18 03:01:26,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d32f9f2bb0be8c8c857dafb4d29282b, NAME => 'testWithMockedMapReduceMultiRegion,,1676689282072.4d32f9f2bb0be8c8c857dafb4d29282b.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 78d5c9bb5537a60ed3978037c58afef9, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676689282072.78d5c9bb5537a60ed3978037c58afef9.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 180ceaed53360deb602f0fcabd1853ac, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676689282072.180ceaed53360deb602f0fcabd1853ac.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 35946dbf681d5e4e055dfff4415006a2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676689282072.35946dbf681d5e4e055dfff4415006a2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 8f222a0b965d27bee2ca86ee76c6d541, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676689282072.8f222a0b965d27bee2ca86ee76c6d541.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => d2d86507c1adce9ee2eac21b9f97e5bc, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676689282072.d2d86507c1adce9ee2eac21b9f97e5bc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => f5dc414d3d4cb7f8063614acb97e1846, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676689282072.f5dc414d3d4cb7f8063614acb97e1846.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 1e26c03cb05d9f1d560ced340dc6c193, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676689282072.1e26c03cb05d9f1d560ced340dc6c193.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 33c551dba25200da53583bfdaa8f761c, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676689282072.33c551dba25200da53583bfdaa8f761c.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 55b565f7e665373341fd12e7280a7e8e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676689282072.55b565f7e665373341fd12e7280a7e8e.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-18 03:01:26,009 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-18 03:01:26,009 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676689286009"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:26,012 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-18 03:01:26,013 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-18 03:01:26,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 100 msec 2023-02-18 03:01:26,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45701] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-18 03:01:26,019 INFO [Listener at localhost.localdomain/39041] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-18 03:01:26,019 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:26,019 INFO [Listener at localhost.localdomain/39041] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:26,019 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21a2b79c to 127.0.0.1:61809 2023-02-18 03:01:26,020 DEBUG [Listener at localhost.localdomain/39041] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,020 DEBUG [Listener at localhost.localdomain/39041] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:26,020 DEBUG [Listener at localhost.localdomain/39041] util.JVMClusterUtil(257): Found active master hash=913237413, stopped=false 2023-02-18 03:01:26,020 INFO [Listener at localhost.localdomain/39041] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:26,021 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:26,021 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:26,021 INFO [Listener at localhost.localdomain/39041] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:26,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:26,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:26,021 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:26,023 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:26,023 DEBUG [Listener at localhost.localdomain/39041] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fc18305 to 127.0.0.1:61809 2023-02-18 03:01:26,024 DEBUG [Listener at localhost.localdomain/39041] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,024 INFO [Listener at localhost.localdomain/39041] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41379,1676689280886' ***** 2023-02-18 03:01:26,024 INFO [Listener at localhost.localdomain/39041] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:26,024 INFO [Listener at localhost.localdomain/39041] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35897,1676689280933' ***** 2023-02-18 03:01:26,024 INFO [Listener at localhost.localdomain/39041] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:26,024 INFO [RS:1;jenkins-hbase20:35897] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:26,024 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:26,024 INFO [RS:1;jenkins-hbase20:35897] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(3304): Received CLOSE for 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:26,026 DEBUG [RS:1;jenkins-hbase20:35897] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x691e0e4a to 127.0.0.1:61809 2023-02-18 03:01:26,026 DEBUG [RS:1;jenkins-hbase20:35897] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:26,026 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:26,028 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 03:01:26,028 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 44bf2f10b1ede7cf040eee5cbbc6a088=hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088.} 2023-02-18 03:01:26,028 INFO [RS:0;jenkins-hbase20:41379] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:26,028 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1505): Waiting on 1588230740, 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:26,028 INFO [RS:0;jenkins-hbase20:41379] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:26,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 44bf2f10b1ede7cf040eee5cbbc6a088, disabling compactions & flushes 2023-02-18 03:01:26,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:26,029 INFO [RS:0;jenkins-hbase20:41379] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:26,031 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:26,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:26,028 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:26,032 DEBUG [RS:0;jenkins-hbase20:41379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bcae7d2 to 127.0.0.1:61809 2023-02-18 03:01:26,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:26,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. after waiting 0 ms 2023-02-18 03:01:26,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:26,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 44bf2f10b1ede7cf040eee5cbbc6a088 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:26,031 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:26,031 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:26,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:26,033 DEBUG [RS:0;jenkins-hbase20:41379] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,035 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41379,1676689280886; all regions closed. 2023-02-18 03:01:26,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:26,035 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:26,035 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:26,035 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:26,035 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.39 KB heapSize=44.49 KB 2023-02-18 03:01:26,059 DEBUG [RS:0;jenkins-hbase20:41379] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/oldWALs 2023-02-18 03:01:26,059 INFO [RS:0;jenkins-hbase20:41379] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41379%2C1676689280886:(num 1676689282249) 2023-02-18 03:01:26,059 DEBUG [RS:0;jenkins-hbase20:41379] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,059 INFO [RS:0;jenkins-hbase20:41379] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:26,059 INFO [RS:0;jenkins-hbase20:41379] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:26,059 INFO [RS:0;jenkins-hbase20:41379] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:26,059 INFO [RS:0;jenkins-hbase20:41379] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:26,059 INFO [RS:0;jenkins-hbase20:41379] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:26,059 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:26,060 INFO [RS:0;jenkins-hbase20:41379] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41379 2023-02-18 03:01:26,070 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:26,071 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:26,071 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41379,1676689280886 2023-02-18 03:01:26,071 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:26,074 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2fee03a2 rejected from java.util.concurrent.ThreadPoolExecutor@2bd18287[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,074 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:26,074 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b33e5 rejected from java.util.concurrent.ThreadPoolExecutor@2bd18287[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,074 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41379,1676689280886] 2023-02-18 03:01:26,075 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41379,1676689280886; numProcessing=1 2023-02-18 03:01:26,075 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41379,1676689280886 already deleted, retry=false 2023-02-18 03:01:26,075 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41379,1676689280886 expired; onlineServers=1 2023-02-18 03:01:26,081 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.76 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/.tmp/info/73f25985e5ed4875b9f7624efd5bfa24 2023-02-18 03:01:26,085 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73f25985e5ed4875b9f7624efd5bfa24 2023-02-18 03:01:26,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/.tmp/rep_barrier/3d5a669f1f254913aa4aa6a08ebf3f04 2023-02-18 03:01:26,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d5a669f1f254913aa4aa6a08ebf3f04 2023-02-18 03:01:26,107 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/.tmp/table/d65f33e6b3f04f608ccc378e0d2e872d 2023-02-18 03:01:26,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d65f33e6b3f04f608ccc378e0d2e872d 2023-02-18 03:01:26,111 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/.tmp/info/73f25985e5ed4875b9f7624efd5bfa24 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/info/73f25985e5ed4875b9f7624efd5bfa24 2023-02-18 03:01:26,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73f25985e5ed4875b9f7624efd5bfa24 2023-02-18 03:01:26,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/info/73f25985e5ed4875b9f7624efd5bfa24, entries=30, sequenceid=57, filesize=8.3 K 2023-02-18 03:01:26,123 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/.tmp/rep_barrier/3d5a669f1f254913aa4aa6a08ebf3f04 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/rep_barrier/3d5a669f1f254913aa4aa6a08ebf3f04 2023-02-18 03:01:26,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d5a669f1f254913aa4aa6a08ebf3f04 2023-02-18 03:01:26,127 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/rep_barrier/3d5a669f1f254913aa4aa6a08ebf3f04, entries=10, sequenceid=57, filesize=6.1 K 2023-02-18 03:01:26,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/.tmp/table/d65f33e6b3f04f608ccc378e0d2e872d as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/table/d65f33e6b3f04f608ccc378e0d2e872d 2023-02-18 03:01:26,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d65f33e6b3f04f608ccc378e0d2e872d 2023-02-18 03:01:26,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/table/d65f33e6b3f04f608ccc378e0d2e872d, entries=13, sequenceid=57, filesize=6.1 K 2023-02-18 03:01:26,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.39 KB/29073, heapSize ~44.45 KB/45512, currentSize=0 B/0 for 1588230740 in 98ms, sequenceid=57, compaction requested=false 2023-02-18 03:01:26,141 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-18 03:01:26,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:26,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:26,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:26,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:26,221 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:26,221 INFO [RS:0;jenkins-hbase20:41379] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41379,1676689280886; zookeeper connection closed. 2023-02-18 03:01:26,221 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7895a79c rejected from java.util.concurrent.ThreadPoolExecutor@2bd18287[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,222 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d1b0997] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d1b0997 2023-02-18 03:01:26,222 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:41379-0x1017387d0e70001, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:26,222 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@576138f7 rejected from java.util.concurrent.ThreadPoolExecutor@2bd18287[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,228 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1505): Waiting on 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:26,316 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 03:01:26,317 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 03:01:26,428 DEBUG [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1505): Waiting on 44bf2f10b1ede7cf040eee5cbbc6a088 2023-02-18 03:01:26,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/.tmp/info/3db510c5b6d64dd3aaab2da986d6fa82 2023-02-18 03:01:26,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/.tmp/info/3db510c5b6d64dd3aaab2da986d6fa82 as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/info/3db510c5b6d64dd3aaab2da986d6fa82 2023-02-18 03:01:26,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/info/3db510c5b6d64dd3aaab2da986d6fa82, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:26,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 44bf2f10b1ede7cf040eee5cbbc6a088 in 465ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:26,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/data/hbase/namespace/44bf2f10b1ede7cf040eee5cbbc6a088/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:26,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:26,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 44bf2f10b1ede7cf040eee5cbbc6a088: 2023-02-18 03:01:26,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689281570.44bf2f10b1ede7cf040eee5cbbc6a088. 2023-02-18 03:01:26,628 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35897,1676689280933; all regions closed. 2023-02-18 03:01:26,635 DEBUG [RS:1;jenkins-hbase20:35897] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/oldWALs 2023-02-18 03:01:26,635 INFO [RS:1;jenkins-hbase20:35897] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35897%2C1676689280933.meta:.meta(num 1676689281521) 2023-02-18 03:01:26,638 DEBUG [RS:1;jenkins-hbase20:35897] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/oldWALs 2023-02-18 03:01:26,638 INFO [RS:1;jenkins-hbase20:35897] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35897%2C1676689280933:(num 1676689281929) 2023-02-18 03:01:26,638 DEBUG [RS:1;jenkins-hbase20:35897] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,638 INFO [RS:1;jenkins-hbase20:35897] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:26,638 INFO [RS:1;jenkins-hbase20:35897] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:26,639 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:26,640 INFO [RS:1;jenkins-hbase20:35897] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35897 2023-02-18 03:01:26,641 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35897,1676689280933 2023-02-18 03:01:26,641 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:26,641 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@158a9fa8 rejected from java.util.concurrent.ThreadPoolExecutor@11b509c1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,642 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35897,1676689280933] 2023-02-18 03:01:26,642 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35897,1676689280933; numProcessing=2 2023-02-18 03:01:26,643 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35897,1676689280933 already deleted, retry=false 2023-02-18 03:01:26,643 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,35897,1676689280933 expired; onlineServers=0 2023-02-18 03:01:26,643 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,45701,1676689280847' ***** 2023-02-18 03:01:26,643 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:26,644 DEBUG [M:0;jenkins-hbase20:45701] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@325177b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:26,644 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,45701,1676689280847 2023-02-18 03:01:26,644 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,45701,1676689280847; all regions closed. 2023-02-18 03:01:26,644 DEBUG [M:0;jenkins-hbase20:45701] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:26,644 DEBUG [M:0;jenkins-hbase20:45701] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:26,644 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:26,644 DEBUG [M:0;jenkins-hbase20:45701] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:26,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689281128] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689281128,5,FailOnTimeoutGroup] 2023-02-18 03:01:26,644 INFO [M:0;jenkins-hbase20:45701] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:26,645 INFO [M:0;jenkins-hbase20:45701] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:26,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689281128] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689281128,5,FailOnTimeoutGroup] 2023-02-18 03:01:26,645 INFO [M:0;jenkins-hbase20:45701] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:26,646 DEBUG [M:0;jenkins-hbase20:45701] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:26,646 INFO [M:0;jenkins-hbase20:45701] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:26,646 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:26,646 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:26,647 ERROR [M:0;jenkins-hbase20:45701] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 03:01:26,647 INFO [M:0;jenkins-hbase20:45701] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:26,647 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:26,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:26,648 DEBUG [M:0;jenkins-hbase20:45701] zookeeper.ZKUtil(398): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:26,648 WARN [M:0;jenkins-hbase20:45701] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:26,648 INFO [M:0;jenkins-hbase20:45701] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:26,648 INFO [M:0;jenkins-hbase20:45701] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:26,649 DEBUG [M:0;jenkins-hbase20:45701] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:26,649 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:26,649 DEBUG [M:0;jenkins-hbase20:45701] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:26,649 DEBUG [M:0;jenkins-hbase20:45701] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:26,649 DEBUG [M:0;jenkins-hbase20:45701] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:26,649 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.42 KB heapSize=200.37 KB 2023-02-18 03:01:26,664 INFO [M:0;jenkins-hbase20:45701] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.42 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7ea8cb03b2084cd4bb5107177c1329ce 2023-02-18 03:01:26,668 DEBUG [M:0;jenkins-hbase20:45701] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7ea8cb03b2084cd4bb5107177c1329ce as hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7ea8cb03b2084cd4bb5107177c1329ce 2023-02-18 03:01:26,671 INFO [M:0;jenkins-hbase20:45701] regionserver.HStore(1080): Added hdfs://localhost.localdomain:34243/user/jenkins/test-data/d59cb3c8-aeaf-15ba-7672-6de060e4966d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7ea8cb03b2084cd4bb5107177c1329ce, entries=53, sequenceid=357, filesize=10.7 K 2023-02-18 03:01:26,672 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegion(2947): Finished flush of dataSize ~167.42 KB/171438, heapSize ~200.35 KB/205160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=357, compaction requested=false 2023-02-18 03:01:26,673 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:26,673 DEBUG [M:0;jenkins-hbase20:45701] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:26,675 INFO [M:0;jenkins-hbase20:45701] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:26,675 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:26,676 INFO [M:0;jenkins-hbase20:45701] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:45701 2023-02-18 03:01:26,677 DEBUG [M:0;jenkins-hbase20:45701] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,45701,1676689280847 already deleted, retry=false 2023-02-18 03:01:26,742 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:26,743 INFO [RS:1;jenkins-hbase20:35897] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35897,1676689280933; zookeeper connection closed. 2023-02-18 03:01:26,743 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@249f3d5e rejected from java.util.concurrent.ThreadPoolExecutor@11b509c1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,743 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e48616f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e48616f 2023-02-18 03:01:26,743 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): regionserver:35897-0x1017387d0e70002, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:26,743 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ceb77df rejected from java.util.concurrent.ThreadPoolExecutor@11b509c1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,744 INFO [Listener at localhost.localdomain/39041] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:26,843 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:26,843 INFO [M:0;jenkins-hbase20:45701] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,45701,1676689280847; zookeeper connection closed. 2023-02-18 03:01:26,843 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e2aee73 rejected from java.util.concurrent.ThreadPoolExecutor@5a15616e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,844 DEBUG [Listener at localhost.localdomain/39041-EventThread] zookeeper.ZKWatcher(600): master:45701-0x1017387d0e70000, quorum=127.0.0.1:61809, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:26,844 WARN [Listener at localhost.localdomain/39041] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:26,844 ERROR [Listener at localhost.localdomain/39041-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2712a04e rejected from java.util.concurrent.ThreadPoolExecutor@5a15616e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:26,848 INFO [Listener at localhost.localdomain/39041] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:26,953 WARN [BP-436697534-148.251.75.209-1676689280308 heartbeating to localhost.localdomain/127.0.0.1:34243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:26,953 WARN [BP-436697534-148.251.75.209-1676689280308 heartbeating to localhost.localdomain/127.0.0.1:34243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-436697534-148.251.75.209-1676689280308 (Datanode Uuid e75122e9-cbb4-4c65-8dfb-b3cd80c10a6c) service to localhost.localdomain/127.0.0.1:34243 2023-02-18 03:01:26,953 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/dfs/data/data3/current/BP-436697534-148.251.75.209-1676689280308] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:26,954 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/dfs/data/data4/current/BP-436697534-148.251.75.209-1676689280308] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:26,956 WARN [Listener at localhost.localdomain/39041] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:26,967 INFO [Listener at localhost.localdomain/39041] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:27,074 WARN [BP-436697534-148.251.75.209-1676689280308 heartbeating to localhost.localdomain/127.0.0.1:34243] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:27,075 WARN [BP-436697534-148.251.75.209-1676689280308 heartbeating to localhost.localdomain/127.0.0.1:34243] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-436697534-148.251.75.209-1676689280308 (Datanode Uuid 3451acef-1fac-4857-aad8-13c147236475) service to localhost.localdomain/127.0.0.1:34243 2023-02-18 03:01:27,078 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/dfs/data/data1/current/BP-436697534-148.251.75.209-1676689280308] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:27,078 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/cluster_191b712b-9f41-bf0c-2920-4515edeab21d/dfs/data/data2/current/BP-436697534-148.251.75.209-1676689280308] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:27,092 INFO [Listener at localhost.localdomain/39041] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:27,212 INFO [Listener at localhost.localdomain/39041] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:27,255 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:27,267 INFO [Listener at localhost.localdomain/39041] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 179) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/39041 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost.localdomain:34243 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:34243 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:34243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:34243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost.localdomain:34243 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:34243 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:34243 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,45701,1676689280847)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/39041.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=631 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 247) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=3103 (was 3305) 2023-02-18 03:01:27,277 INFO [Listener at localhost.localdomain/39041] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=165, AvailableMemoryMB=3103 2023-02-18 03:01:27,288 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/hadoop.log.dir so I do NOT create it in target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5 2023-02-18 03:01:27,289 WARN [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 03:01:27,289 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/hadoop.tmp.dir so I do NOT create it in target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5 2023-02-18 03:01:27,289 WARN [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9d1ba96f-4b23-8e65-3cd8-75e286810c0a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 03:01:27,289 DEBUG [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5 2023-02-18 03:01:27,289 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:01:27,289 INFO [Listener at localhost.localdomain/39041] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e, deleteOnExit=true 2023-02-18 03:01:27,289 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:01:27,289 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/test.cache.data in system properties and HBase conf 2023-02-18 03:01:27,289 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:01:27,290 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:01:27,290 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:01:27,290 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:01:27,290 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:01:27,290 DEBUG [Listener at localhost.localdomain/39041] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:01:27,290 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:27,290 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:27,291 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:01:27,292 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:01:27,292 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:01:27,292 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:27,292 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:01:27,292 INFO [Listener at localhost.localdomain/39041] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:01:27,295 WARN [Listener at localhost.localdomain/39041] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:27,295 WARN [Listener at localhost.localdomain/39041] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:27,319 WARN [Listener at localhost.localdomain/39041] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:27,322 INFO [Listener at localhost.localdomain/39041] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:27,327 INFO [Listener at localhost.localdomain/39041] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/java.io.tmpdir/Jetty_localhost_localdomain_33911_hdfs____.u3mxkd/webapp 2023-02-18 03:01:27,399 INFO [Listener at localhost.localdomain/39041] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:33911 2023-02-18 03:01:27,402 WARN [Listener at localhost.localdomain/39041] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:27,402 WARN [Listener at localhost.localdomain/39041] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:27,439 WARN [Listener at localhost.localdomain/41885] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:27,448 WARN [Listener at localhost.localdomain/41885] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:27,450 WARN [Listener at localhost.localdomain/41885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:27,451 INFO [Listener at localhost.localdomain/41885] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:27,455 INFO [Listener at localhost.localdomain/41885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/java.io.tmpdir/Jetty_localhost_36293_datanode____.st8wsw/webapp 2023-02-18 03:01:27,529 INFO [Listener at localhost.localdomain/41885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36293 2023-02-18 03:01:27,535 WARN [Listener at localhost.localdomain/38585] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:27,553 WARN [Listener at localhost.localdomain/38585] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:27,556 WARN [Listener at localhost.localdomain/38585] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:27,557 INFO [Listener at localhost.localdomain/38585] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:27,561 INFO [Listener at localhost.localdomain/38585] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/java.io.tmpdir/Jetty_localhost_35209_datanode____prkmf4/webapp 2023-02-18 03:01:27,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xff8e900dccf991b0: Processing first storage report for DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2 from datanode fcf58e32-b2b0-4f44-a7e8-97aae7ba854e 2023-02-18 03:01:27,625 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xff8e900dccf991b0: from storage DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2 node DatanodeRegistration(127.0.0.1:33291, datanodeUuid=fcf58e32-b2b0-4f44-a7e8-97aae7ba854e, infoPort=44993, infoSecurePort=0, ipcPort=38585, storageInfo=lv=-57;cid=testClusterID;nsid=1088699892;c=1676689287296), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:27,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xff8e900dccf991b0: Processing first storage report for DS-6a731e97-040e-4092-82de-721d093469e6 from datanode fcf58e32-b2b0-4f44-a7e8-97aae7ba854e 2023-02-18 03:01:27,625 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xff8e900dccf991b0: from storage DS-6a731e97-040e-4092-82de-721d093469e6 node DatanodeRegistration(127.0.0.1:33291, datanodeUuid=fcf58e32-b2b0-4f44-a7e8-97aae7ba854e, infoPort=44993, infoSecurePort=0, ipcPort=38585, storageInfo=lv=-57;cid=testClusterID;nsid=1088699892;c=1676689287296), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:27,644 INFO [Listener at localhost.localdomain/38585] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35209 2023-02-18 03:01:27,652 WARN [Listener at localhost.localdomain/36527] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:27,830 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14a598aeaf93f842: Processing first storage report for DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9 from datanode b490309e-9ab8-4fee-a099-a385e2688a8d 2023-02-18 03:01:27,830 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14a598aeaf93f842: from storage DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9 node DatanodeRegistration(127.0.0.1:41795, datanodeUuid=b490309e-9ab8-4fee-a099-a385e2688a8d, infoPort=37979, infoSecurePort=0, ipcPort=36527, storageInfo=lv=-57;cid=testClusterID;nsid=1088699892;c=1676689287296), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:27,830 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x14a598aeaf93f842: Processing first storage report for DS-604aa5d4-24cf-4d2c-ae50-dd19b79b2963 from datanode b490309e-9ab8-4fee-a099-a385e2688a8d 2023-02-18 03:01:27,830 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x14a598aeaf93f842: from storage DS-604aa5d4-24cf-4d2c-ae50-dd19b79b2963 node DatanodeRegistration(127.0.0.1:41795, datanodeUuid=b490309e-9ab8-4fee-a099-a385e2688a8d, infoPort=37979, infoSecurePort=0, ipcPort=36527, storageInfo=lv=-57;cid=testClusterID;nsid=1088699892;c=1676689287296), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:27,871 DEBUG [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5 2023-02-18 03:01:27,879 INFO [Listener at localhost.localdomain/36527] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/zookeeper_0, clientPort=49237, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:01:27,881 INFO [Listener at localhost.localdomain/36527] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49237 2023-02-18 03:01:27,881 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,882 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,898 INFO [Listener at localhost.localdomain/36527] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53 with version=8 2023-02-18 03:01:27,898 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,899 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,900 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/hbase-staging 2023-02-18 03:01:27,901 INFO [Listener at localhost.localdomain/36527] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:27,901 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,901 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,902 INFO [Listener at localhost.localdomain/36527] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:27,902 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,902 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:27,902 INFO [Listener at localhost.localdomain/36527] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:27,902 INFO [Listener at localhost.localdomain/36527] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35103 2023-02-18 03:01:27,903 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,903 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,904 INFO [Listener at localhost.localdomain/36527] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35103 connecting to ZooKeeper ensemble=127.0.0.1:49237 2023-02-18 03:01:27,910 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:351030x0, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:27,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35103-0x1017387ec710000 connected 2023-02-18 03:01:27,918 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:27,919 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:27,919 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:27,920 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35103 2023-02-18 03:01:27,920 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35103 2023-02-18 03:01:27,920 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35103 2023-02-18 03:01:27,920 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35103 2023-02-18 03:01:27,920 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35103 2023-02-18 03:01:27,921 INFO [Listener at localhost.localdomain/36527] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53, hbase.cluster.distributed=false 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:27,933 INFO [Listener at localhost.localdomain/36527] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:27,934 INFO [Listener at localhost.localdomain/36527] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39575 2023-02-18 03:01:27,934 INFO [Listener at localhost.localdomain/36527] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:27,938 DEBUG [Listener at localhost.localdomain/36527] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:27,939 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,939 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,940 INFO [Listener at localhost.localdomain/36527] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39575 connecting to ZooKeeper ensemble=127.0.0.1:49237 2023-02-18 03:01:27,942 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:395750x0, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:27,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39575-0x1017387ec710001 connected 2023-02-18 03:01:27,944 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:27,944 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:27,945 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:27,945 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39575 2023-02-18 03:01:27,945 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39575 2023-02-18 03:01:27,946 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39575 2023-02-18 03:01:27,948 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39575 2023-02-18 03:01:27,948 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39575 2023-02-18 03:01:27,957 INFO [Listener at localhost.localdomain/36527] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:27,957 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,957 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,958 INFO [Listener at localhost.localdomain/36527] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:27,958 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:27,958 INFO [Listener at localhost.localdomain/36527] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:27,958 INFO [Listener at localhost.localdomain/36527] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:27,958 INFO [Listener at localhost.localdomain/36527] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46595 2023-02-18 03:01:27,959 INFO [Listener at localhost.localdomain/36527] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:27,959 DEBUG [Listener at localhost.localdomain/36527] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:27,959 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,960 INFO [Listener at localhost.localdomain/36527] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:27,961 INFO [Listener at localhost.localdomain/36527] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46595 connecting to ZooKeeper ensemble=127.0.0.1:49237 2023-02-18 03:01:27,963 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:465950x0, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:27,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46595-0x1017387ec710002 connected 2023-02-18 03:01:27,965 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:27,965 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:27,966 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:27,966 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46595 2023-02-18 03:01:27,966 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46595 2023-02-18 03:01:27,966 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46595 2023-02-18 03:01:27,967 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46595 2023-02-18 03:01:27,967 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46595 2023-02-18 03:01:27,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:27,969 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:27,970 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:27,970 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:27,970 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:27,970 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:27,970 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:27,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:27,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,35103,1676689287901 from backup master directory 2023-02-18 03:01:27,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:27,974 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:27,974 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:27,974 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:27,974 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:27,986 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/hbase.id with ID: 9d102e06-9289-47ed-831f-fe75a1d53df0 2023-02-18 03:01:27,997 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:28,000 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,008 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x120549b8 to 127.0.0.1:49237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:28,014 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@712a54a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:28,014 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:28,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:01:28,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:28,017 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store-tmp 2023-02-18 03:01:28,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:28,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:28,022 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:28,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:28,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:28,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:28,022 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:28,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:28,023 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/WALs/jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:28,024 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35103%2C1676689287901, suffix=, logDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/WALs/jenkins-hbase20.apache.org,35103,1676689287901, archiveDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/oldWALs, maxLogs=10 2023-02-18 03:01:28,036 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK] 2023-02-18 03:01:28,036 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK] 2023-02-18 03:01:28,038 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/WALs/jenkins-hbase20.apache.org,35103,1676689287901/jenkins-hbase20.apache.org%2C35103%2C1676689287901.1676689288024 2023-02-18 03:01:28,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK], DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK]] 2023-02-18 03:01:28,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:28,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:28,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:28,038 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:28,040 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:28,041 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:01:28,041 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:01:28,041 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,042 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:28,042 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:28,044 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:28,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:28,046 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62923707, jitterRate=-0.062363699078559875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:28,046 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:28,047 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:01:28,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:01:28,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:01:28,048 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:01:28,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 03:01:28,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 03:01:28,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:01:28,050 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:01:28,050 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:01:28,064 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:01:28,064 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:01:28,064 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:01:28,064 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:01:28,065 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:01:28,066 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,066 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:01:28,067 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:01:28,067 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:01:28,068 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:28,068 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:28,068 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,068 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:28,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,35103,1676689287901, sessionid=0x1017387ec710000, setting cluster-up flag (Was=false) 2023-02-18 03:01:28,071 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,074 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:01:28,074 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:28,076 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,078 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:01:28,078 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:28,079 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.hbase-snapshot/.tmp 2023-02-18 03:01:28,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:28,080 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:28,081 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,082 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689318082 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:01:28,083 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:28,083 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,083 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:01:28,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:01:28,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:01:28,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:01:28,084 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:01:28,084 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:28,085 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689288084,5,FailOnTimeoutGroup] 2023-02-18 03:01:28,085 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689288085,5,FailOnTimeoutGroup] 2023-02-18 03:01:28,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:01:28,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,085 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,092 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:28,093 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:28,093 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53 2023-02-18 03:01:28,104 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:28,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:28,106 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/info 2023-02-18 03:01:28,107 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:28,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:28,108 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:28,108 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:28,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:28,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/table 2023-02-18 03:01:28,109 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:28,109 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,110 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740 2023-02-18 03:01:28,110 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740 2023-02-18 03:01:28,112 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:28,113 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:28,114 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:28,114 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62941927, jitterRate=-0.06209219992160797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:28,114 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:28,114 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:28,115 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:28,115 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:28,115 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:28,115 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:28,115 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:28,115 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:28,117 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:28,117 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:01:28,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:01:28,118 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:01:28,119 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:01:28,170 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(952): ClusterId : 9d102e06-9289-47ed-831f-fe75a1d53df0 2023-02-18 03:01:28,170 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(952): ClusterId : 9d102e06-9289-47ed-831f-fe75a1d53df0 2023-02-18 03:01:28,170 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:28,170 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:28,173 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:28,173 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:28,173 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:28,173 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:28,176 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:28,178 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:28,179 DEBUG [RS:1;jenkins-hbase20:46595] zookeeper.ReadOnlyZKClient(139): Connect 0x6ae504d2 to 127.0.0.1:49237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:28,179 DEBUG [RS:0;jenkins-hbase20:39575] zookeeper.ReadOnlyZKClient(139): Connect 0x137f7cde to 127.0.0.1:49237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:28,190 DEBUG [RS:0;jenkins-hbase20:39575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1db890c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:28,190 DEBUG [RS:0;jenkins-hbase20:39575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@198717ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:28,190 DEBUG [RS:1;jenkins-hbase20:46595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6422f7fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:28,191 DEBUG [RS:1;jenkins-hbase20:46595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@601d6fa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:28,200 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:46595 2023-02-18 03:01:28,200 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:39575 2023-02-18 03:01:28,200 INFO [RS:1;jenkins-hbase20:46595] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:28,200 INFO [RS:1;jenkins-hbase20:46595] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:28,200 INFO [RS:0;jenkins-hbase20:39575] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:28,200 INFO [RS:0;jenkins-hbase20:39575] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:28,200 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:28,200 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:28,201 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,35103,1676689287901 with isa=jenkins-hbase20.apache.org/148.251.75.209:46595, startcode=1676689287957 2023-02-18 03:01:28,201 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,35103,1676689287901 with isa=jenkins-hbase20.apache.org/148.251.75.209:39575, startcode=1676689287933 2023-02-18 03:01:28,201 DEBUG [RS:1;jenkins-hbase20:46595] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:28,201 DEBUG [RS:0;jenkins-hbase20:39575] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:28,203 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54973, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:28,203 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59837, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:28,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35103] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,205 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53 2023-02-18 03:01:28,205 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41885 2023-02-18 03:01:28,205 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:28,205 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53 2023-02-18 03:01:28,205 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:41885 2023-02-18 03:01:28,205 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:28,207 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:28,207 DEBUG [RS:0;jenkins-hbase20:39575] zookeeper.ZKUtil(162): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,207 DEBUG [RS:1;jenkins-hbase20:46595] zookeeper.ZKUtil(162): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,208 WARN [RS:0;jenkins-hbase20:39575] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:28,208 WARN [RS:1;jenkins-hbase20:46595] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:28,208 INFO [RS:0;jenkins-hbase20:39575] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:28,208 INFO [RS:1;jenkins-hbase20:46595] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:28,208 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,39575,1676689287933] 2023-02-18 03:01:28,208 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,208 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46595,1676689287957] 2023-02-18 03:01:28,208 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,214 DEBUG [RS:1;jenkins-hbase20:46595] zookeeper.ZKUtil(162): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,214 DEBUG [RS:0;jenkins-hbase20:39575] zookeeper.ZKUtil(162): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,215 DEBUG [RS:1;jenkins-hbase20:46595] zookeeper.ZKUtil(162): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,215 DEBUG [RS:0;jenkins-hbase20:39575] zookeeper.ZKUtil(162): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,215 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:28,215 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:28,216 INFO [RS:0;jenkins-hbase20:39575] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:28,216 INFO [RS:1;jenkins-hbase20:46595] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:28,217 INFO [RS:0;jenkins-hbase20:39575] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:28,217 INFO [RS:0;jenkins-hbase20:39575] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:28,217 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,217 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:28,218 INFO [RS:1;jenkins-hbase20:46595] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:28,219 INFO [RS:1;jenkins-hbase20:46595] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:28,219 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,223 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:28,223 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,224 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,224 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,224 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,224 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,224 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,225 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,225 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:28,226 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,226 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,226 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,226 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,226 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,226 DEBUG [RS:0;jenkins-hbase20:39575] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,227 DEBUG [RS:1;jenkins-hbase20:46595] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:28,239 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,239 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,239 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,248 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,248 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,248 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,258 INFO [RS:1;jenkins-hbase20:46595] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:28,258 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46595,1676689287957-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,258 INFO [RS:0;jenkins-hbase20:39575] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:28,258 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39575,1676689287933-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,269 INFO [RS:1;jenkins-hbase20:46595] regionserver.Replication(203): jenkins-hbase20.apache.org,46595,1676689287957 started 2023-02-18 03:01:28,269 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,46595,1676689287957, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46595, sessionid=0x1017387ec710002 2023-02-18 03:01:28,269 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:28,269 DEBUG [RS:1;jenkins-hbase20:46595] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,269 DEBUG [RS:1;jenkins-hbase20:46595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46595,1676689287957' 2023-02-18 03:01:28,269 DEBUG [RS:1;jenkins-hbase20:46595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:28,270 DEBUG [jenkins-hbase20:35103] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:28,270 DEBUG [jenkins-hbase20:35103] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46595,1676689287957' 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:28,270 INFO [RS:0;jenkins-hbase20:39575] regionserver.Replication(203): jenkins-hbase20.apache.org,39575,1676689287933 started 2023-02-18 03:01:28,270 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,39575,1676689287933, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:39575, sessionid=0x1017387ec710001 2023-02-18 03:01:28,270 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:28,270 DEBUG [RS:0;jenkins-hbase20:39575] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,270 DEBUG [RS:0;jenkins-hbase20:39575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39575,1676689287933' 2023-02-18 03:01:28,270 DEBUG [RS:1;jenkins-hbase20:46595] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:28,270 DEBUG [RS:0;jenkins-hbase20:39575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:28,270 INFO [RS:1;jenkins-hbase20:46595] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:28,271 INFO [RS:1;jenkins-hbase20:46595] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:28,271 DEBUG [RS:0;jenkins-hbase20:39575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:28,271 DEBUG [jenkins-hbase20:35103] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:28,271 DEBUG [jenkins-hbase20:35103] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:28,271 DEBUG [jenkins-hbase20:35103] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:28,271 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:28,271 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:28,271 DEBUG [RS:0;jenkins-hbase20:39575] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,271 DEBUG [RS:0;jenkins-hbase20:39575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39575,1676689287933' 2023-02-18 03:01:28,271 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39575,1676689287933, state=OPENING 2023-02-18 03:01:28,271 DEBUG [RS:0;jenkins-hbase20:39575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:28,272 DEBUG [RS:0;jenkins-hbase20:39575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:28,272 DEBUG [RS:0;jenkins-hbase20:39575] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:28,272 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:01:28,272 INFO [RS:0;jenkins-hbase20:39575] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:28,272 INFO [RS:0;jenkins-hbase20:39575] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:28,273 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,273 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:28,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39575,1676689287933}] 2023-02-18 03:01:28,430 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:28,431 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:28,434 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42384, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:28,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:01:28,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:28,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39575%2C1676689287933.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,39575,1676689287933, archiveDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/oldWALs, maxLogs=32 2023-02-18 03:01:28,456 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK] 2023-02-18 03:01:28,457 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK] 2023-02-18 03:01:28,458 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,39575,1676689287933/jenkins-hbase20.apache.org%2C39575%2C1676689287933.meta.1676689288441.meta 2023-02-18 03:01:28,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK]] 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:01:28,459 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:01:28,459 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:01:28,460 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:28,461 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/info 2023-02-18 03:01:28,461 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/info 2023-02-18 03:01:28,461 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:28,462 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,462 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:28,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:28,463 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:28,463 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:28,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:28,465 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/table 2023-02-18 03:01:28,465 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/table 2023-02-18 03:01:28,465 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:28,466 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,466 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740 2023-02-18 03:01:28,468 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740 2023-02-18 03:01:28,469 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:28,470 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:28,470 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71735182, jitterRate=0.0689375102519989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:28,471 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:28,471 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689288430 2023-02-18 03:01:28,475 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:01:28,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:01:28,476 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39575,1676689287933, state=OPEN 2023-02-18 03:01:28,477 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:01:28,477 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:28,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:01:28,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39575,1676689287933 in 204 msec 2023-02-18 03:01:28,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:01:28,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-18 03:01:28,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 400 msec 2023-02-18 03:01:28,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689288480, completionTime=-1 2023-02-18 03:01:28,481 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:01:28,481 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:01:28,484 DEBUG [hconnection-0x4b8711e3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:28,490 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42394, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:28,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:01:28,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689348492 2023-02-18 03:01:28,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689408492 2023-02-18 03:01:28,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-18 03:01:28,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35103,1676689287901-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35103,1676689287901-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35103,1676689287901-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:35103, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:28,498 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:01:28,499 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:28,499 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:01:28,501 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:01:28,501 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:28,501 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:28,503 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,503 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766 empty. 2023-02-18 03:01:28,504 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,504 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:01:28,514 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:28,515 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2f850cb7bcf693452eea52db368bd766, NAME => 'hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp 2023-02-18 03:01:28,520 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:28,520 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 2f850cb7bcf693452eea52db368bd766, disabling compactions & flushes 2023-02-18 03:01:28,520 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,520 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,520 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. after waiting 0 ms 2023-02-18 03:01:28,520 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,520 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,520 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 2f850cb7bcf693452eea52db368bd766: 2023-02-18 03:01:28,522 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:28,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689288523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689288523"}]},"ts":"1676689288523"} 2023-02-18 03:01:28,525 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:28,526 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:28,526 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689288526"}]},"ts":"1676689288526"} 2023-02-18 03:01:28,527 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:01:28,528 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:28,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:28,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:28,529 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:28,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2f850cb7bcf693452eea52db368bd766, ASSIGN}] 2023-02-18 03:01:28,532 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2f850cb7bcf693452eea52db368bd766, ASSIGN 2023-02-18 03:01:28,532 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2f850cb7bcf693452eea52db368bd766, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46595,1676689287957; forceNewPlan=false, retain=false 2023-02-18 03:01:28,682 INFO [jenkins-hbase20:35103] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:28,683 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2f850cb7bcf693452eea52db368bd766, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,683 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689288683"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689288683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689288683"}]},"ts":"1676689288683"} 2023-02-18 03:01:28,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2f850cb7bcf693452eea52db368bd766, server=jenkins-hbase20.apache.org,46595,1676689287957}] 2023-02-18 03:01:28,837 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,837 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:28,839 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36260, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:28,842 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,843 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46595%2C1676689287957, suffix=, logDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,46595,1676689287957, archiveDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/oldWALs, maxLogs=32 2023-02-18 03:01:28,861 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK] 2023-02-18 03:01:28,861 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK] 2023-02-18 03:01:28,863 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,46595,1676689287957/jenkins-hbase20.apache.org%2C46595%2C1676689287957.1676689288844 2023-02-18 03:01:28,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK]] 2023-02-18 03:01:28,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2f850cb7bcf693452eea52db368bd766, NAME => 'hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:28,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:28,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,866 INFO [StoreOpener-2f850cb7bcf693452eea52db368bd766-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,868 DEBUG [StoreOpener-2f850cb7bcf693452eea52db368bd766-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/info 2023-02-18 03:01:28,868 DEBUG [StoreOpener-2f850cb7bcf693452eea52db368bd766-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/info 2023-02-18 03:01:28,868 INFO [StoreOpener-2f850cb7bcf693452eea52db368bd766-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f850cb7bcf693452eea52db368bd766 columnFamilyName info 2023-02-18 03:01:28,869 INFO [StoreOpener-2f850cb7bcf693452eea52db368bd766-1] regionserver.HStore(310): Store=2f850cb7bcf693452eea52db368bd766/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:28,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,871 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:28,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:28,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 2f850cb7bcf693452eea52db368bd766; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63844099, jitterRate=-0.04864878952503204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:28,873 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 2f850cb7bcf693452eea52db368bd766: 2023-02-18 03:01:28,873 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766., pid=6, masterSystemTime=1676689288837 2023-02-18 03:01:28,877 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,878 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:28,878 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2f850cb7bcf693452eea52db368bd766, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:28,878 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689288878"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689288878"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689288878"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689288878"}]},"ts":"1676689288878"} 2023-02-18 03:01:28,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:01:28,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2f850cb7bcf693452eea52db368bd766, server=jenkins-hbase20.apache.org,46595,1676689287957 in 196 msec 2023-02-18 03:01:28,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:01:28,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2f850cb7bcf693452eea52db368bd766, ASSIGN in 352 msec 2023-02-18 03:01:28,883 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:28,883 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689288883"}]},"ts":"1676689288883"} 2023-02-18 03:01:28,884 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:01:28,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:28,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 386 msec 2023-02-18 03:01:28,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:01:28,901 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:28,902 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:28,904 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:28,905 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:28,908 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:01:28,918 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:28,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-18 03:01:28,930 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:01:28,938 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:28,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-18 03:01:28,954 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:01:28,956 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:01:28,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.982sec 2023-02-18 03:01:28,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:01:28,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:01:28,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:01:28,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35103,1676689287901-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:01:28,957 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35103,1676689287901-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:01:28,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:01:28,971 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ReadOnlyZKClient(139): Connect 0x67324494 to 127.0.0.1:49237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:28,983 DEBUG [Listener at localhost.localdomain/36527] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69faa8f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:28,985 DEBUG [hconnection-0x2d2eaa62-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:28,987 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:28,988 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:28,988 DEBUG [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:01:28,993 DEBUG [Listener at localhost.localdomain/36527] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:01:28,995 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44182, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:01:28,996 INFO [Listener at localhost.localdomain/36527] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-18 03:01:28,997 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-18 03:01:28,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:01:28,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 148.251.75.209:44182 deadline: 1676689348996, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-18 03:01:28,997 INFO [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-18 03:01:29,000 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:29,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,003 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:29,003 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-18 03:01:29,003 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:29,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:29,007 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,008 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b empty. 2023-02-18 03:01:29,008 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,008 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-18 03:01:29,015 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:29,016 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b4fb9f7b02a6e2445f4d90708ebfa60b, NAME => 'testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp 2023-02-18 03:01:29,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:29,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing b4fb9f7b02a6e2445f4d90708ebfa60b, disabling compactions & flushes 2023-02-18 03:01:29,023 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. after waiting 0 ms 2023-02-18 03:01:29,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,023 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:29,025 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:29,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676689289026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689289026"}]},"ts":"1676689289026"} 2023-02-18 03:01:29,027 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:29,028 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:29,028 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689289028"}]},"ts":"1676689289028"} 2023-02-18 03:01:29,029 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-18 03:01:29,031 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:29,032 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:29,032 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:29,032 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:29,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, ASSIGN}] 2023-02-18 03:01:29,043 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, ASSIGN 2023-02-18 03:01:29,044 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46595,1676689287957; forceNewPlan=false, retain=false 2023-02-18 03:01:29,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:29,194 INFO [jenkins-hbase20:35103] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:29,195 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b4fb9f7b02a6e2445f4d90708ebfa60b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,195 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676689289195"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689289195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689289195"}]},"ts":"1676689289195"} 2023-02-18 03:01:29,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b4fb9f7b02a6e2445f4d90708ebfa60b, server=jenkins-hbase20.apache.org,46595,1676689287957}] 2023-02-18 03:01:29,274 INFO [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39575%2C1676689287933, suffix=, logDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,39575,1676689287933, archiveDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/oldWALs, maxLogs=32 2023-02-18 03:01:29,290 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK] 2023-02-18 03:01:29,290 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK] 2023-02-18 03:01:29,292 INFO [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,39575,1676689287933/jenkins-hbase20.apache.org%2C39575%2C1676689287933.1676689289274 2023-02-18 03:01:29,292 DEBUG [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41795,DS-a72aec04-b40f-46fe-a1cd-1ab8d601d5d9,DISK], DatanodeInfoWithStorage[127.0.0.1:33291,DS-56bacc01-93b0-4f0f-9a3b-a5b5244e30e2,DISK]] 2023-02-18 03:01:29,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:29,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b4fb9f7b02a6e2445f4d90708ebfa60b, NAME => 'testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:29,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:29,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,358 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,359 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1 2023-02-18 03:01:29,359 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1 2023-02-18 03:01:29,360 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4fb9f7b02a6e2445f4d90708ebfa60b columnFamilyName f1 2023-02-18 03:01:29,360 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(310): Store=b4fb9f7b02a6e2445f4d90708ebfa60b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:29,360 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,362 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2 2023-02-18 03:01:29,362 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2 2023-02-18 03:01:29,362 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4fb9f7b02a6e2445f4d90708ebfa60b columnFamilyName f2 2023-02-18 03:01:29,363 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(310): Store=b4fb9f7b02a6e2445f4d90708ebfa60b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:29,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:29,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:29,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened b4fb9f7b02a6e2445f4d90708ebfa60b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65668439, jitterRate=-0.02146400511264801}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:29,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:29,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b., pid=12, masterSystemTime=1676689289351 2023-02-18 03:01:29,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,372 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b4fb9f7b02a6e2445f4d90708ebfa60b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,372 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676689289372"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689289372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689289372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689289372"}]},"ts":"1676689289372"} 2023-02-18 03:01:29,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 03:01:29,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b4fb9f7b02a6e2445f4d90708ebfa60b, server=jenkins-hbase20.apache.org,46595,1676689287957 in 175 msec 2023-02-18 03:01:29,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 03:01:29,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, ASSIGN in 343 msec 2023-02-18 03:01:29,377 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:29,377 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689289377"}]},"ts":"1676689289377"} 2023-02-18 03:01:29,378 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-18 03:01:29,380 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:29,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 380 msec 2023-02-18 03:01:29,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:29,611 INFO [Listener at localhost.localdomain/36527] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-18 03:01:29,611 DEBUG [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-18 03:01:29,612 INFO [Listener at localhost.localdomain/36527] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:29,617 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-18 03:01:29,617 INFO [Listener at localhost.localdomain/36527] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:29,617 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-18 03:01:29,617 INFO [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:01:29,636 DEBUG [hconnection-0x2d2eaa62-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:29,650 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:29,657 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46595] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,733 INFO [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:01:29,733 INFO [Listener at localhost.localdomain/36527] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:01:29,734 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 03:01:29,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689289734 (current time:1676689289734). 2023-02-18 03:01:29,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:01:29,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] zookeeper.ReadOnlyZKClient(139): Connect 0x49393fcf to 127.0.0.1:49237 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:29,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3995f0d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:29,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:29,739 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:29,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49393fcf to 127.0.0.1:49237 2023-02-18 03:01:29,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:29,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:01:29,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 03:01:29,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 03:01:29,743 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 03:01:29,744 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676689889744 2023-02-18 03:01:29,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-18 03:01:29,744 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,745 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:29,745 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:01:29,745 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-18 03:01:29,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 03:01:29,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-18 03:01:29,747 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 03:01:29,747 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676689889747 2023-02-18 03:01:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,755 INFO [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-18 03:01:29,756 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:29,756 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-18 03:01:29,757 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 03:01:29,757 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,757 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,758 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:29,758 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:29,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:29,758 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:29,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:29,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:29,759 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,759 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:29,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,760 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-18 03:01:29,760 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:29,760 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-18 03:01:29,761 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 03:01:29,761 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 03:01:29,761 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46595,1676689287957' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 03:01:29,761 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:29,762 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 03:01:29,762 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 03:01:29,762 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39575,1676689287933' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 03:01:29,763 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,763 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:29,763 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,763 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,763 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:29,763 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,763 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:29,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:29,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46595,1676689287957' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-18 03:01:29,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@688704ba[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:29,765 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 03:01:29,765 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 03:01:29,765 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 03:01:29,766 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 03:01:29,766 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 03:01:29,766 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:29,766 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:29,766 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,766 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,39575,1676689287933' in zk 2023-02-18 03:01:29,766 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. started... 2023-02-18 03:01:29,766 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b4fb9f7b02a6e2445f4d90708ebfa60b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 03:01:29,767 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 03:01:29,767 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:29,767 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 03:01:29,782 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f1/e040c9a6e2f64b5082ef756410dbfa7f 2023-02-18 03:01:29,804 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f2/b21455f516544633bc1e2dad66f88bed 2023-02-18 03:01:29,808 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f1/e040c9a6e2f64b5082ef756410dbfa7f as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/e040c9a6e2f64b5082ef756410dbfa7f 2023-02-18 03:01:29,812 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/e040c9a6e2f64b5082ef756410dbfa7f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:29,813 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f2/b21455f516544633bc1e2dad66f88bed as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/b21455f516544633bc1e2dad66f88bed 2023-02-18 03:01:29,819 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/b21455f516544633bc1e2dad66f88bed, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:29,820 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b4fb9f7b02a6e2445f4d90708ebfa60b in 54ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:29,820 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-18 03:01:29,820 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:29,821 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,821 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:29,821 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/e040c9a6e2f64b5082ef756410dbfa7f] hfiles 2023-02-18 03:01:29,821 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/e040c9a6e2f64b5082ef756410dbfa7f for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,821 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/b21455f516544633bc1e2dad66f88bed] hfiles 2023-02-18 03:01:29,821 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/b21455f516544633bc1e2dad66f88bed for snapshot=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,828 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. completed. 2023-02-18 03:01:29,828 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:29,828 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 03:01:29,828 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 03:01:29,828 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,828 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 03:01:29,828 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,46595,1676689287957' in zk 2023-02-18 03:01:29,829 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 03:01:29,829 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:29,829 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,829 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 03:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,46595,1676689287957': 2023-02-18 03:01:29,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46595,1676689287957' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 03:01:29,832 INFO [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-18 03:01:29,832 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:29,832 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:29,832 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,832 INFO [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:01:29,833 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,833 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,833 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:29,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,833 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:29,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,833 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:29,834 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:29,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,834 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,835 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:29,835 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:29,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,838 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:29,838 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,839 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:29,839 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,839 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:29,839 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,839 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,845 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:29,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-18 03:01:29,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:29,847 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:01:29,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-18 03:01:29,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:29,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676689289744Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676689289838 (+94 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676689289838Writing data manifest for testWithMockedMapReduceSingleRegion at 1676689289840 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676689289845 (+5 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676689289867 (+22 ms) 2023-02-18 03:01:29,868 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-18 03:01:29,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 123 msec 2023-02-18 03:01:30,047 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:30,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-18 03:01:30,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:30,048 INFO [Listener at localhost.localdomain/36527] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:30,053 INFO [Listener at localhost.localdomain/36527] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:30,060 INFO [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:30,092 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46595] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,176 INFO [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:30,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:30,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,182 INFO [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-18 03:01:30,182 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:30,183 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-18 03:01:30,183 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 03:01:30,184 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,184 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,185 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,185 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:30,185 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:30,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:30,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:30,185 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,185 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,188 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-18 03:01:30,188 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:30,188 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39575,1676689287933' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 03:01:30,189 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:30,189 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,190 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. started... 2023-02-18 03:01:30,190 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b4fb9f7b02a6e2445f4d90708ebfa60b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 03:01:30,195 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,196 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,196 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:30,204 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f1/fb0a9c4b0dd84d9d8035886a4a92d1ce 2023-02-18 03:01:30,221 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f2/17eb941c9a514191b1a87e6ea7216f01 2023-02-18 03:01:30,224 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f1/fb0a9c4b0dd84d9d8035886a4a92d1ce as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/fb0a9c4b0dd84d9d8035886a4a92d1ce 2023-02-18 03:01:30,228 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/fb0a9c4b0dd84d9d8035886a4a92d1ce, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:30,229 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/.tmp/f2/17eb941c9a514191b1a87e6ea7216f01 as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/17eb941c9a514191b1a87e6ea7216f01 2023-02-18 03:01:30,234 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/17eb941c9a514191b1a87e6ea7216f01, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:30,235 INFO [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b4fb9f7b02a6e2445f4d90708ebfa60b in 45ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:30,236 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:30,236 DEBUG [rs(jenkins-hbase20.apache.org,46595,1676689287957)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,236 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 03:01:30,236 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 03:01:30,236 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,236 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-18 03:01:30,236 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46595,1676689287957' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-18 03:01:30,237 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,237 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:30,238 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,238 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:30,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46595,1676689287957' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-18 03:01:30,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cb88d72[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:30,240 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 03:01:30,240 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,240 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,240 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 03:01:30,241 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,241 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,46595,1676689287957' in zk 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,39575,1676689287933' in zk 2023-02-18 03:01:30,241 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 03:01:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:30,241 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:30,242 DEBUG [member: 'jenkins-hbase20.apache.org,46595,1676689287957' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 03:01:30,242 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-18 03:01:30,242 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:30,242 DEBUG [member: 'jenkins-hbase20.apache.org,39575,1676689287933' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,46595,1676689287957': 2023-02-18 03:01:30,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46595,1676689287957' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 03:01:30,244 INFO [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-18 03:01:30,244 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:30,244 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:30,244 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,244 INFO [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:30,245 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:30,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:30,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:30,245 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:30,245 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,246 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:30,247 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:30,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:30,248 DEBUG [(jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,248 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-18 03:01:30,248 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:30,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:30,248 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:30,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:30,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,249 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:30,349 DEBUG [Listener at localhost.localdomain/36527] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:30,361 INFO [Listener at localhost.localdomain/36527] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676689289734 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:30,361 DEBUG [Listener at localhost.localdomain/36527] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1/data/default/testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,362 INFO [Listener at localhost.localdomain/36527] snapshot.RestoreSnapshotHelper(239): region to add: b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,362 INFO [Listener at localhost.localdomain/36527] snapshot.RestoreSnapshotHelper(585): clone region=b4fb9f7b02a6e2445f4d90708ebfa60b as b4fb9f7b02a6e2445f4d90708ebfa60b in snapshot testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,362 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b4fb9f7b02a6e2445f4d90708ebfa60b, NAME => 'testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1 2023-02-18 03:01:30,370 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:30,370 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e040c9a6e2f64b5082ef756410dbfa7f from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,372 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b21455f516544633bc1e2dad66f88bed from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,373 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b4fb9f7b02a6e2445f4d90708ebfa60b, disabling compactions & flushes 2023-02-18 03:01:30,373 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,373 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,373 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. after waiting 0 ms 2023-02-18 03:01:30,373 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,373 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,373 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:30,374 INFO [Listener at localhost.localdomain/36527] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676689289734 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:30,374 DEBUG [Listener at localhost.localdomain/36527] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1 2023-02-18 03:01:30,374 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1 2023-02-18 03:01:30,374 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:30,374 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:30,375 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-18 03:01:30,375 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(699): |----------b4fb9f7b02a6e2445f4d90708ebfa60b/ 2023-02-18 03:01:30,376 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:30,376 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:30,376 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=b4fb9f7b02a6e2445f4d90708ebfa60b-e040c9a6e2f64b5082ef756410dbfa7f 2023-02-18 03:01:30,376 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:30,376 DEBUG [Listener at localhost.localdomain/36527] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=b4fb9f7b02a6e2445f4d90708ebfa60b-b21455f516544633bc1e2dad66f88bed 2023-02-18 03:01:30,379 INFO [Listener at localhost.localdomain/36527] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 03:01:30,382 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:30,382 INFO [Listener at localhost.localdomain/36527] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:30,382 DEBUG [Listener at localhost.localdomain/36527] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:30,384 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,385 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1 2023-02-18 03:01:30,386 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4fb9f7b02a6e2445f4d90708ebfa60b columnFamilyName f1 2023-02-18 03:01:30,390 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/testWithMockedMapReduceSingleRegion=b4fb9f7b02a6e2445f4d90708ebfa60b-e040c9a6e2f64b5082ef756410dbfa7f 2023-02-18 03:01:30,390 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(310): Store=b4fb9f7b02a6e2445f4d90708ebfa60b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:30,390 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,391 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2 2023-02-18 03:01:30,391 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b4fb9f7b02a6e2445f4d90708ebfa60b columnFamilyName f2 2023-02-18 03:01:30,436 DEBUG [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:41885/user/jenkins/test-data/0a65e1ea-4bab-d774-e28b-10135ac05a44/testWithMockedMapReduceSingleRegion/cd7a747f-7bab-4553-9a1f-f5592b616fc1/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/testWithMockedMapReduceSingleRegion=b4fb9f7b02a6e2445f4d90708ebfa60b-b21455f516544633bc1e2dad66f88bed 2023-02-18 03:01:30,436 INFO [StoreOpener-b4fb9f7b02a6e2445f4d90708ebfa60b-1] regionserver.HStore(310): Store=b4fb9f7b02a6e2445f4d90708ebfa60b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:30,437 DEBUG [Listener at localhost.localdomain/36527] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:30,437 INFO [Listener at localhost.localdomain/36527] regionserver.HRegion(1071): Opened b4fb9f7b02a6e2445f4d90708ebfa60b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62532257, jitterRate=-0.06819675862789154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:30,437 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(964): Region open journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:30,479 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(1603): Closing b4fb9f7b02a6e2445f4d90708ebfa60b, disabling compactions & flushes 2023-02-18 03:01:30,479 INFO [Listener at localhost.localdomain/36527] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,479 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,479 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. after waiting 0 ms 2023-02-18 03:01:30,479 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,480 INFO [Listener at localhost.localdomain/36527] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,480 DEBUG [Listener at localhost.localdomain/36527] regionserver.HRegion(1557): Region close journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:30,484 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-18 03:01:30,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,487 INFO [Listener at localhost.localdomain/36527] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:30,490 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689290490"}]},"ts":"1676689290490"} 2023-02-18 03:01:30,491 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-18 03:01:30,492 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-18 03:01:30,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, UNASSIGN}] 2023-02-18 03:01:30,494 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, UNASSIGN 2023-02-18 03:01:30,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b4fb9f7b02a6e2445f4d90708ebfa60b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676689290494"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689290494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689290494"}]},"ts":"1676689290494"} 2023-02-18 03:01:30,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b4fb9f7b02a6e2445f4d90708ebfa60b, server=jenkins-hbase20.apache.org,46595,1676689287957}] 2023-02-18 03:01:30,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:30,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing b4fb9f7b02a6e2445f4d90708ebfa60b, disabling compactions & flushes 2023-02-18 03:01:30,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. after waiting 0 ms 2023-02-18 03:01:30,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:30,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b. 2023-02-18 03:01:30,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for b4fb9f7b02a6e2445f4d90708ebfa60b: 2023-02-18 03:01:30,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b4fb9f7b02a6e2445f4d90708ebfa60b, regionState=CLOSED 2023-02-18 03:01:30,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676689290651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689290651"}]},"ts":"1676689290651"} 2023-02-18 03:01:30,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 03:01:30,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b4fb9f7b02a6e2445f4d90708ebfa60b, server=jenkins-hbase20.apache.org,46595,1676689287957 in 157 msec 2023-02-18 03:01:30,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 03:01:30,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=b4fb9f7b02a6e2445f4d90708ebfa60b, UNASSIGN in 160 msec 2023-02-18 03:01:30,655 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689290655"}]},"ts":"1676689290655"} 2023-02-18 03:01:30,656 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-18 03:01:30,657 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-18 03:01:30,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 170 msec 2023-02-18 03:01:30,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:30,796 INFO [Listener at localhost.localdomain/36527] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-18 03:01:30,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,800 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,801 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:30,804 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1, FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2, FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/recovered.edits] 2023-02-18 03:01:30,811 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/e040c9a6e2f64b5082ef756410dbfa7f to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/archive/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/e040c9a6e2f64b5082ef756410dbfa7f 2023-02-18 03:01:30,813 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/fb0a9c4b0dd84d9d8035886a4a92d1ce to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/archive/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f1/fb0a9c4b0dd84d9d8035886a4a92d1ce 2023-02-18 03:01:30,816 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/17eb941c9a514191b1a87e6ea7216f01 to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/archive/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/17eb941c9a514191b1a87e6ea7216f01 2023-02-18 03:01:30,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/b21455f516544633bc1e2dad66f88bed to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/archive/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/f2/b21455f516544633bc1e2dad66f88bed 2023-02-18 03:01:30,821 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/recovered.edits/12.seqid to hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/archive/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b/recovered.edits/12.seqid 2023-02-18 03:01:30,822 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/.tmp/data/default/testWithMockedMapReduceSingleRegion/b4fb9f7b02a6e2445f4d90708ebfa60b 2023-02-18 03:01:30,822 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-18 03:01:30,825 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,826 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-18 03:01:30,831 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-18 03:01:30,832 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,832 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-18 03:01:30,832 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689290832"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:30,834 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 03:01:30,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b4fb9f7b02a6e2445f4d90708ebfa60b, NAME => 'testWithMockedMapReduceSingleRegion,,1676689288999.b4fb9f7b02a6e2445f4d90708ebfa60b.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 03:01:30,834 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-18 03:01:30,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676689290834"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:30,836 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-18 03:01:30,837 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-18 03:01:30,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 40 msec 2023-02-18 03:01:30,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35103] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:30,903 INFO [Listener at localhost.localdomain/36527] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-18 03:01:30,903 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:30,903 INFO [Listener at localhost.localdomain/36527] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:30,903 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67324494 to 127.0.0.1:49237 2023-02-18 03:01:30,903 DEBUG [Listener at localhost.localdomain/36527] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:30,904 DEBUG [Listener at localhost.localdomain/36527] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:30,904 DEBUG [Listener at localhost.localdomain/36527] util.JVMClusterUtil(257): Found active master hash=1484645997, stopped=false 2023-02-18 03:01:30,904 INFO [Listener at localhost.localdomain/36527] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:30,904 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:30,904 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:30,904 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:30,904 INFO [Listener at localhost.localdomain/36527] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:30,904 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:30,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:30,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:30,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:30,906 DEBUG [Listener at localhost.localdomain/36527] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x120549b8 to 127.0.0.1:49237 2023-02-18 03:01:30,906 DEBUG [Listener at localhost.localdomain/36527] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:30,906 INFO [Listener at localhost.localdomain/36527] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39575,1676689287933' ***** 2023-02-18 03:01:30,906 INFO [Listener at localhost.localdomain/36527] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:30,906 INFO [Listener at localhost.localdomain/36527] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,46595,1676689287957' ***** 2023-02-18 03:01:30,906 INFO [Listener at localhost.localdomain/36527] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:30,907 INFO [RS:0;jenkins-hbase20:39575] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:30,907 INFO [RS:0;jenkins-hbase20:39575] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:30,907 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:30,907 INFO [RS:1;jenkins-hbase20:46595] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:30,908 INFO [RS:1;jenkins-hbase20:46595] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:30,908 INFO [RS:1;jenkins-hbase20:46595] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:30,908 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(3304): Received CLOSE for 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:30,908 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:30,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 2f850cb7bcf693452eea52db368bd766, disabling compactions & flushes 2023-02-18 03:01:30,908 INFO [RS:0;jenkins-hbase20:39575] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:30,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:30,908 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:30,908 DEBUG [RS:1;jenkins-hbase20:46595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ae504d2 to 127.0.0.1:49237 2023-02-18 03:01:30,908 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:30,908 DEBUG [RS:1;jenkins-hbase20:46595] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:30,908 DEBUG [RS:0;jenkins-hbase20:39575] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x137f7cde to 127.0.0.1:49237 2023-02-18 03:01:30,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:30,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. after waiting 0 ms 2023-02-18 03:01:30,909 DEBUG [RS:0;jenkins-hbase20:39575] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:30,909 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 03:01:30,909 INFO [RS:0;jenkins-hbase20:39575] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:30,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:30,910 INFO [RS:0;jenkins-hbase20:39575] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:30,910 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1479): Online Regions={2f850cb7bcf693452eea52db368bd766=hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766.} 2023-02-18 03:01:30,910 DEBUG [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1505): Waiting on 2f850cb7bcf693452eea52db368bd766 2023-02-18 03:01:30,910 INFO [RS:0;jenkins-hbase20:39575] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:30,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 2f850cb7bcf693452eea52db368bd766 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:30,910 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:30,910 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 03:01:30,910 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:30,910 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 03:01:30,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:30,910 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:30,910 DEBUG [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 03:01:30,910 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:30,910 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:30,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-18 03:01:30,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.58 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/.tmp/info/095d20749aee46fbaf82dfae7be10239 2023-02-18 03:01:30,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/.tmp/info/4ddf782849c6489b95d4f4552d13e63c 2023-02-18 03:01:30,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 095d20749aee46fbaf82dfae7be10239 2023-02-18 03:01:30,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/.tmp/info/4ddf782849c6489b95d4f4552d13e63c as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/info/4ddf782849c6489b95d4f4552d13e63c 2023-02-18 03:01:30,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/info/4ddf782849c6489b95d4f4552d13e63c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:30,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2f850cb7bcf693452eea52db368bd766 in 16ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:30,932 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/.tmp/rep_barrier/046ef9a8b3b04cd2868e5af88a7410e9 2023-02-18 03:01:30,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/namespace/2f850cb7bcf693452eea52db368bd766/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:30,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:30,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 2f850cb7bcf693452eea52db368bd766: 2023-02-18 03:01:30,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689288498.2f850cb7bcf693452eea52db368bd766. 2023-02-18 03:01:30,934 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 046ef9a8b3b04cd2868e5af88a7410e9 2023-02-18 03:01:30,940 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/.tmp/table/ae992adc230f49aaa963179a102487ba 2023-02-18 03:01:30,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae992adc230f49aaa963179a102487ba 2023-02-18 03:01:30,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/.tmp/info/095d20749aee46fbaf82dfae7be10239 as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/info/095d20749aee46fbaf82dfae7be10239 2023-02-18 03:01:30,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 095d20749aee46fbaf82dfae7be10239 2023-02-18 03:01:30,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/info/095d20749aee46fbaf82dfae7be10239, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 03:01:30,948 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/.tmp/rep_barrier/046ef9a8b3b04cd2868e5af88a7410e9 as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/rep_barrier/046ef9a8b3b04cd2868e5af88a7410e9 2023-02-18 03:01:30,950 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:30,951 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:30,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 046ef9a8b3b04cd2868e5af88a7410e9 2023-02-18 03:01:30,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/rep_barrier/046ef9a8b3b04cd2868e5af88a7410e9, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 03:01:30,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/.tmp/table/ae992adc230f49aaa963179a102487ba as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/table/ae992adc230f49aaa963179a102487ba 2023-02-18 03:01:30,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae992adc230f49aaa963179a102487ba 2023-02-18 03:01:30,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/table/ae992adc230f49aaa963179a102487ba, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 03:01:30,960 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4316, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false 2023-02-18 03:01:30,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 03:01:30,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:30,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:30,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:30,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:31,110 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,46595,1676689287957; all regions closed. 2023-02-18 03:01:31,110 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39575,1676689287933; all regions closed. 2023-02-18 03:01:31,115 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/WALs/jenkins-hbase20.apache.org,39575,1676689287933/jenkins-hbase20.apache.org%2C39575%2C1676689287933.meta.1676689288441.meta not finished, retry = 0 2023-02-18 03:01:31,117 DEBUG [RS:1;jenkins-hbase20:46595] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/oldWALs 2023-02-18 03:01:31,117 INFO [RS:1;jenkins-hbase20:46595] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46595%2C1676689287957:(num 1676689288844) 2023-02-18 03:01:31,117 DEBUG [RS:1;jenkins-hbase20:46595] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:31,117 INFO [RS:1;jenkins-hbase20:46595] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:31,118 INFO [RS:1;jenkins-hbase20:46595] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:31,118 INFO [RS:1;jenkins-hbase20:46595] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:31,118 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:31,118 INFO [RS:1;jenkins-hbase20:46595] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:31,118 INFO [RS:1;jenkins-hbase20:46595] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:31,119 INFO [RS:1;jenkins-hbase20:46595] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46595 2023-02-18 03:01:31,121 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:31,121 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:31,121 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:31,121 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46595,1676689287957 2023-02-18 03:01:31,121 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43560af2 rejected from java.util.concurrent.ThreadPoolExecutor@47699640[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,121 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:31,122 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46595,1676689287957] 2023-02-18 03:01:31,122 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46595,1676689287957; numProcessing=1 2023-02-18 03:01:31,122 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46595,1676689287957 already deleted, retry=false 2023-02-18 03:01:31,122 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46595,1676689287957 expired; onlineServers=1 2023-02-18 03:01:31,218 DEBUG [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/oldWALs 2023-02-18 03:01:31,218 INFO [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39575%2C1676689287933.meta:.meta(num 1676689288441) 2023-02-18 03:01:31,221 DEBUG [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/oldWALs 2023-02-18 03:01:31,221 INFO [RS:0;jenkins-hbase20:39575] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39575%2C1676689287933:(num 1676689289274) 2023-02-18 03:01:31,221 DEBUG [RS:0;jenkins-hbase20:39575] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:31,221 INFO [RS:0;jenkins-hbase20:39575] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:31,221 INFO [RS:0;jenkins-hbase20:39575] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:31,221 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:31,222 INFO [RS:0;jenkins-hbase20:39575] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39575 2023-02-18 03:01:31,223 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,39575,1676689287933 2023-02-18 03:01:31,223 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:31,223 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1effb0be rejected from java.util.concurrent.ThreadPoolExecutor@1ac037b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,223 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,39575,1676689287933] 2023-02-18 03:01:31,223 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,39575,1676689287933; numProcessing=2 2023-02-18 03:01:31,224 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,39575,1676689287933 already deleted, retry=false 2023-02-18 03:01:31,224 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,39575,1676689287933 expired; onlineServers=0 2023-02-18 03:01:31,224 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35103,1676689287901' ***** 2023-02-18 03:01:31,224 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:31,225 DEBUG [M:0;jenkins-hbase20:35103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c4279ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:31,225 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35103,1676689287901 2023-02-18 03:01:31,225 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35103,1676689287901; all regions closed. 2023-02-18 03:01:31,225 DEBUG [M:0;jenkins-hbase20:35103] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:31,225 DEBUG [M:0;jenkins-hbase20:35103] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:31,225 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:31,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689288084] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689288084,5,FailOnTimeoutGroup] 2023-02-18 03:01:31,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689288085] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689288085,5,FailOnTimeoutGroup] 2023-02-18 03:01:31,225 DEBUG [M:0;jenkins-hbase20:35103] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:31,226 INFO [M:0;jenkins-hbase20:35103] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:31,226 INFO [M:0;jenkins-hbase20:35103] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:31,226 INFO [M:0;jenkins-hbase20:35103] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:31,226 DEBUG [M:0;jenkins-hbase20:35103] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:31,226 INFO [M:0;jenkins-hbase20:35103] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:31,227 ERROR [M:0;jenkins-hbase20:35103] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 03:01:31,227 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:31,227 INFO [M:0;jenkins-hbase20:35103] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:31,227 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:31,227 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:31,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:31,227 DEBUG [M:0;jenkins-hbase20:35103] zookeeper.ZKUtil(398): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:31,228 WARN [M:0;jenkins-hbase20:35103] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:31,228 INFO [M:0;jenkins-hbase20:35103] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:31,228 INFO [M:0;jenkins-hbase20:35103] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:31,228 DEBUG [M:0;jenkins-hbase20:35103] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:31,228 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:31,228 DEBUG [M:0;jenkins-hbase20:35103] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:31,228 DEBUG [M:0;jenkins-hbase20:35103] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:31,228 DEBUG [M:0;jenkins-hbase20:35103] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:31,228 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.18 KB heapSize=67.12 KB 2023-02-18 03:01:31,245 INFO [M:0;jenkins-hbase20:35103] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.18 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0effb6a29d03470ca9abb0e701664e44 2023-02-18 03:01:31,248 DEBUG [M:0;jenkins-hbase20:35103] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0effb6a29d03470ca9abb0e701664e44 as hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0effb6a29d03470ca9abb0e701664e44 2023-02-18 03:01:31,251 INFO [M:0;jenkins-hbase20:35103] regionserver.HStore(1080): Added hdfs://localhost.localdomain:41885/user/jenkins/test-data/629c3bc9-81d6-c6ef-e656-e6354d7f8a53/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0effb6a29d03470ca9abb0e701664e44, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 03:01:31,252 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegion(2947): Finished flush of dataSize ~56.18 KB/57532, heapSize ~67.10 KB/68712, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false 2023-02-18 03:01:31,252 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:31,252 DEBUG [M:0;jenkins-hbase20:35103] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:31,254 INFO [M:0;jenkins-hbase20:35103] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:31,254 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:31,255 INFO [M:0;jenkins-hbase20:35103] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35103 2023-02-18 03:01:31,256 DEBUG [M:0;jenkins-hbase20:35103] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,35103,1676689287901 already deleted, retry=false 2023-02-18 03:01:31,279 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 03:01:31,406 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:31,406 INFO [M:0;jenkins-hbase20:35103] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35103,1676689287901; zookeeper connection closed. 2023-02-18 03:01:31,407 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23c83636 rejected from java.util.concurrent.ThreadPoolExecutor@27f7a697[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,407 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): master:35103-0x1017387ec710000, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:31,407 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31c6b541 rejected from java.util.concurrent.ThreadPoolExecutor@27f7a697[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,507 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:31,507 INFO [RS:0;jenkins-hbase20:39575] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39575,1676689287933; zookeeper connection closed. 2023-02-18 03:01:31,507 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@d4e7ba0 rejected from java.util.concurrent.ThreadPoolExecutor@1ac037b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,508 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:39575-0x1017387ec710001, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:31,508 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40518c2b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40518c2b 2023-02-18 03:01:31,508 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@75b1df6b rejected from java.util.concurrent.ThreadPoolExecutor@1ac037b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,607 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:31,607 INFO [RS:1;jenkins-hbase20:46595] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,46595,1676689287957; zookeeper connection closed. 2023-02-18 03:01:31,607 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40d115c9 rejected from java.util.concurrent.ThreadPoolExecutor@47699640[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,608 DEBUG [Listener at localhost.localdomain/36527-EventThread] zookeeper.ZKWatcher(600): regionserver:46595-0x1017387ec710002, quorum=127.0.0.1:49237, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:31,608 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f70a4d3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f70a4d3 2023-02-18 03:01:31,608 ERROR [Listener at localhost.localdomain/36527-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38f3cd19 rejected from java.util.concurrent.ThreadPoolExecutor@47699640[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:31,608 INFO [Listener at localhost.localdomain/36527] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:31,609 WARN [Listener at localhost.localdomain/36527] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:31,615 INFO [Listener at localhost.localdomain/36527] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:31,728 WARN [BP-1279673343-148.251.75.209-1676689287296 heartbeating to localhost.localdomain/127.0.0.1:41885] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:31,729 WARN [BP-1279673343-148.251.75.209-1676689287296 heartbeating to localhost.localdomain/127.0.0.1:41885] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1279673343-148.251.75.209-1676689287296 (Datanode Uuid b490309e-9ab8-4fee-a099-a385e2688a8d) service to localhost.localdomain/127.0.0.1:41885 2023-02-18 03:01:31,730 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/dfs/data/data3/current/BP-1279673343-148.251.75.209-1676689287296] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:31,731 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/dfs/data/data4/current/BP-1279673343-148.251.75.209-1676689287296] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:31,732 WARN [Listener at localhost.localdomain/36527] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:31,736 INFO [Listener at localhost.localdomain/36527] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:31,843 WARN [BP-1279673343-148.251.75.209-1676689287296 heartbeating to localhost.localdomain/127.0.0.1:41885] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:31,843 WARN [BP-1279673343-148.251.75.209-1676689287296 heartbeating to localhost.localdomain/127.0.0.1:41885] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1279673343-148.251.75.209-1676689287296 (Datanode Uuid fcf58e32-b2b0-4f44-a7e8-97aae7ba854e) service to localhost.localdomain/127.0.0.1:41885 2023-02-18 03:01:31,844 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/dfs/data/data1/current/BP-1279673343-148.251.75.209-1676689287296] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:31,845 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/cluster_e2b697e0-b0a5-c6e9-b3e9-8a6cace6a78e/dfs/data/data2/current/BP-1279673343-148.251.75.209-1676689287296] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:31,859 INFO [Listener at localhost.localdomain/36527] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:31,976 INFO [Listener at localhost.localdomain/36527] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:31,996 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:32,007 INFO [Listener at localhost.localdomain/36527] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 230) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost.localdomain:41885 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36527 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/36527.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:41885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,35103,1676689287901)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:41885 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:41885 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:41885 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost.localdomain:41885 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:41885 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=657 (was 631) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 291), ProcessCount=165 (was 165), AvailableMemoryMB=3009 (was 3103) 2023-02-18 03:01:32,017 INFO [Listener at localhost.localdomain/36527] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=657, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=165, AvailableMemoryMB=3009 2023-02-18 03:01:32,028 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/hadoop.log.dir so I do NOT create it in target/test-data/b00296ab-70ae-fb36-1224-57803e342405 2023-02-18 03:01:32,028 WARN [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 03:01:32,028 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/hadoop.tmp.dir so I do NOT create it in target/test-data/b00296ab-70ae-fb36-1224-57803e342405 2023-02-18 03:01:32,028 WARN [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4d35d8d7-b5ec-f040-5edd-94d03ea271f5/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 03:01:32,028 DEBUG [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405 2023-02-18 03:01:32,028 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:01:32,028 INFO [Listener at localhost.localdomain/36527] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf, deleteOnExit=true 2023-02-18 03:01:32,028 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/test.cache.data in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:01:32,029 DEBUG [Listener at localhost.localdomain/36527] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:32,029 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:32,030 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:01:32,031 INFO [Listener at localhost.localdomain/36527] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:01:32,033 WARN [Listener at localhost.localdomain/36527] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:32,033 WARN [Listener at localhost.localdomain/36527] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:32,055 WARN [Listener at localhost.localdomain/36527] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:32,057 INFO [Listener at localhost.localdomain/36527] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:32,062 INFO [Listener at localhost.localdomain/36527] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/java.io.tmpdir/Jetty_localhost_localdomain_41743_hdfs____lpkylv/webapp 2023-02-18 03:01:32,149 INFO [Listener at localhost.localdomain/36527] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:41743 2023-02-18 03:01:32,151 WARN [Listener at localhost.localdomain/36527] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:32,152 WARN [Listener at localhost.localdomain/36527] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:32,189 WARN [Listener at localhost.localdomain/37371] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:32,200 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:32,205 WARN [Listener at localhost.localdomain/37371] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:32,206 WARN [Listener at localhost.localdomain/37371] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:32,208 INFO [Listener at localhost.localdomain/37371] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:32,213 INFO [Listener at localhost.localdomain/37371] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/java.io.tmpdir/Jetty_localhost_43655_datanode____az55q/webapp 2023-02-18 03:01:32,294 INFO [Listener at localhost.localdomain/37371] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43655 2023-02-18 03:01:32,303 WARN [Listener at localhost.localdomain/39775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:32,317 WARN [Listener at localhost.localdomain/39775] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:32,319 WARN [Listener at localhost.localdomain/39775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:32,320 INFO [Listener at localhost.localdomain/39775] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:32,330 INFO [Listener at localhost.localdomain/39775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/java.io.tmpdir/Jetty_localhost_34375_datanode____k0unnb/webapp 2023-02-18 03:01:32,383 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb386f592d501f7a7: Processing first storage report for DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7 from datanode 4d191810-ece1-4581-93f3-d2b06c922fcb 2023-02-18 03:01:32,383 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb386f592d501f7a7: from storage DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7 node DatanodeRegistration(127.0.0.1:34771, datanodeUuid=4d191810-ece1-4581-93f3-d2b06c922fcb, infoPort=35083, infoSecurePort=0, ipcPort=39775, storageInfo=lv=-57;cid=testClusterID;nsid=1981287388;c=1676689292034), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:32,383 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb386f592d501f7a7: Processing first storage report for DS-bc6ecac2-3002-432c-919b-90d793ef0968 from datanode 4d191810-ece1-4581-93f3-d2b06c922fcb 2023-02-18 03:01:32,383 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb386f592d501f7a7: from storage DS-bc6ecac2-3002-432c-919b-90d793ef0968 node DatanodeRegistration(127.0.0.1:34771, datanodeUuid=4d191810-ece1-4581-93f3-d2b06c922fcb, infoPort=35083, infoSecurePort=0, ipcPort=39775, storageInfo=lv=-57;cid=testClusterID;nsid=1981287388;c=1676689292034), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:32,420 INFO [Listener at localhost.localdomain/39775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34375 2023-02-18 03:01:32,430 WARN [Listener at localhost.localdomain/34401] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:32,492 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3329629217cbef9: Processing first storage report for DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6 from datanode 2035fc6d-41b9-4607-b0a4-59c6b82547a6 2023-02-18 03:01:32,492 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3329629217cbef9: from storage DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6 node DatanodeRegistration(127.0.0.1:46403, datanodeUuid=2035fc6d-41b9-4607-b0a4-59c6b82547a6, infoPort=42389, infoSecurePort=0, ipcPort=34401, storageInfo=lv=-57;cid=testClusterID;nsid=1981287388;c=1676689292034), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:32,492 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3329629217cbef9: Processing first storage report for DS-0ceeb172-da43-4afd-ba8d-716f96949039 from datanode 2035fc6d-41b9-4607-b0a4-59c6b82547a6 2023-02-18 03:01:32,492 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3329629217cbef9: from storage DS-0ceeb172-da43-4afd-ba8d-716f96949039 node DatanodeRegistration(127.0.0.1:46403, datanodeUuid=2035fc6d-41b9-4607-b0a4-59c6b82547a6, infoPort=42389, infoSecurePort=0, ipcPort=34401, storageInfo=lv=-57;cid=testClusterID;nsid=1981287388;c=1676689292034), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:32,542 DEBUG [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405 2023-02-18 03:01:32,545 INFO [Listener at localhost.localdomain/34401] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/zookeeper_0, clientPort=64473, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:01:32,546 INFO [Listener at localhost.localdomain/34401] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64473 2023-02-18 03:01:32,546 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,547 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,566 INFO [Listener at localhost.localdomain/34401] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5 with version=8 2023-02-18 03:01:32,566 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,568 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,570 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37371/user/jenkins/test-data/e0b10c1c-25b5-f18a-a1d0-b3ac9dc910c6/hbase-staging 2023-02-18 03:01:32,573 INFO [Listener at localhost.localdomain/34401] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:32,573 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,573 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,574 INFO [Listener at localhost.localdomain/34401] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:32,574 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,574 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:32,574 INFO [Listener at localhost.localdomain/34401] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:32,575 INFO [Listener at localhost.localdomain/34401] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33089 2023-02-18 03:01:32,576 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,577 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,578 INFO [Listener at localhost.localdomain/34401] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33089 connecting to ZooKeeper ensemble=127.0.0.1:64473 2023-02-18 03:01:32,590 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:330890x0, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:32,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33089-0x1017387feb00000 connected 2023-02-18 03:01:32,617 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:32,618 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:32,618 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:32,621 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33089 2023-02-18 03:01:32,622 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33089 2023-02-18 03:01:32,625 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33089 2023-02-18 03:01:32,627 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33089 2023-02-18 03:01:32,627 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33089 2023-02-18 03:01:32,627 INFO [Listener at localhost.localdomain/34401] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5, hbase.cluster.distributed=false 2023-02-18 03:01:32,637 INFO [Listener at localhost.localdomain/34401] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:32,638 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,638 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,638 INFO [Listener at localhost.localdomain/34401] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:32,638 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,638 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:32,638 INFO [Listener at localhost.localdomain/34401] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:32,639 INFO [Listener at localhost.localdomain/34401] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43805 2023-02-18 03:01:32,639 INFO [Listener at localhost.localdomain/34401] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:32,642 DEBUG [Listener at localhost.localdomain/34401] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:32,642 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,643 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,643 INFO [Listener at localhost.localdomain/34401] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43805 connecting to ZooKeeper ensemble=127.0.0.1:64473 2023-02-18 03:01:32,645 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:438050x0, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:32,646 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): regionserver:438050x0, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:32,646 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): regionserver:438050x0, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:32,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43805-0x1017387feb00001 connected 2023-02-18 03:01:32,647 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:32,652 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43805 2023-02-18 03:01:32,652 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43805 2023-02-18 03:01:32,652 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43805 2023-02-18 03:01:32,653 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43805 2023-02-18 03:01:32,654 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43805 2023-02-18 03:01:32,667 INFO [Listener at localhost.localdomain/34401] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:32,668 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,668 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,668 INFO [Listener at localhost.localdomain/34401] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:32,668 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:32,668 INFO [Listener at localhost.localdomain/34401] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:32,668 INFO [Listener at localhost.localdomain/34401] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:32,671 INFO [Listener at localhost.localdomain/34401] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37835 2023-02-18 03:01:32,671 INFO [Listener at localhost.localdomain/34401] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:32,672 DEBUG [Listener at localhost.localdomain/34401] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:32,673 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,673 INFO [Listener at localhost.localdomain/34401] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,674 INFO [Listener at localhost.localdomain/34401] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37835 connecting to ZooKeeper ensemble=127.0.0.1:64473 2023-02-18 03:01:32,675 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:378350x0, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:32,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37835-0x1017387feb00002 connected 2023-02-18 03:01:32,676 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:32,677 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:32,677 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:32,681 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37835 2023-02-18 03:01:32,682 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37835 2023-02-18 03:01:32,682 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37835 2023-02-18 03:01:32,682 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37835 2023-02-18 03:01:32,682 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37835 2023-02-18 03:01:32,686 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,689 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:32,690 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,690 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:32,690 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:32,690 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:32,690 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:32,693 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:32,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:32,693 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,33089,1676689292572 from backup master directory 2023-02-18 03:01:32,694 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,694 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:32,694 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:32,694 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,709 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/hbase.id with ID: 161cb681-605e-421a-b4c5-b04cb1ee50d3 2023-02-18 03:01:32,716 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:32,717 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:32,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x40506d6b to 127.0.0.1:64473 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:32,751 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@169ef04e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:32,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:32,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:01:32,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:32,754 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store-tmp 2023-02-18 03:01:32,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:32,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:32,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:32,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:32,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:32,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:32,775 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:32,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:32,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/WALs/jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,778 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33089%2C1676689292572, suffix=, logDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/WALs/jenkins-hbase20.apache.org,33089,1676689292572, archiveDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/oldWALs, maxLogs=10 2023-02-18 03:01:32,795 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK] 2023-02-18 03:01:32,795 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK] 2023-02-18 03:01:32,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/WALs/jenkins-hbase20.apache.org,33089,1676689292572/jenkins-hbase20.apache.org%2C33089%2C1676689292572.1676689292779 2023-02-18 03:01:32,819 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK], DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK]] 2023-02-18 03:01:32,819 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:32,819 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:32,819 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:32,819 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:32,823 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:32,825 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:01:32,825 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:01:32,826 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:32,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:32,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:32,828 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:32,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:32,830 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59630402, jitterRate=-0.11143776774406433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:32,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:32,831 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:01:32,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:01:32,833 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:01:32,833 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:01:32,833 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 03:01:32,834 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 03:01:32,834 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:01:32,835 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:01:32,836 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:01:32,846 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:01:32,846 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:01:32,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:01:32,847 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:01:32,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:01:32,848 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:32,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:01:32,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:01:32,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:01:32,850 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:32,850 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:32,850 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:32,850 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:32,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,33089,1676689292572, sessionid=0x1017387feb00000, setting cluster-up flag (Was=false) 2023-02-18 03:01:32,855 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:32,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:01:32,857 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,859 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:32,860 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:01:32,861 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:32,861 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.hbase-snapshot/.tmp 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:32,864 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,866 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689322866 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:01:32,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,867 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:32,867 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:01:32,868 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:32,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:01:32,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:01:32,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:01:32,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:01:32,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:01:32,871 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689292871,5,FailOnTimeoutGroup] 2023-02-18 03:01:32,871 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689292871,5,FailOnTimeoutGroup] 2023-02-18 03:01:32,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:01:32,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,881 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:32,881 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:32,881 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5 2023-02-18 03:01:32,886 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(952): ClusterId : 161cb681-605e-421a-b4c5-b04cb1ee50d3 2023-02-18 03:01:32,886 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(952): ClusterId : 161cb681-605e-421a-b4c5-b04cb1ee50d3 2023-02-18 03:01:32,886 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:32,886 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:32,887 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:32,888 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:32,888 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:32,888 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:32,888 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:32,889 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:32,889 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:32,891 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:32,891 DEBUG [RS:1;jenkins-hbase20:37835] zookeeper.ReadOnlyZKClient(139): Connect 0x7b9906aa to 127.0.0.1:64473 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:32,891 DEBUG [RS:0;jenkins-hbase20:43805] zookeeper.ReadOnlyZKClient(139): Connect 0x3f3d4787 to 127.0.0.1:64473 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:32,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/info 2023-02-18 03:01:32,893 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:32,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:32,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:32,894 DEBUG [RS:1;jenkins-hbase20:37835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755ee7a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:32,894 DEBUG [RS:0;jenkins-hbase20:43805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31faae10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:32,894 DEBUG [RS:1;jenkins-hbase20:37835] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71616dda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:32,894 DEBUG [RS:0;jenkins-hbase20:43805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35c52cf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:32,894 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:32,894 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:32,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:32,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:32,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/table 2023-02-18 03:01:32,896 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:32,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:32,897 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740 2023-02-18 03:01:32,897 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740 2023-02-18 03:01:32,898 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:32,899 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:32,900 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:32,900 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60071002, jitterRate=-0.10487231612205505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:32,900 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:32,901 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:32,901 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:32,901 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:32,901 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:32,901 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:32,901 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:32,901 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:32,901 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:32,901 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:01:32,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:01:32,902 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:37835 2023-02-18 03:01:32,902 INFO [RS:1;jenkins-hbase20:37835] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:32,902 INFO [RS:1;jenkins-hbase20:37835] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:32,902 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:32,903 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:01:32,904 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33089,1676689292572 with isa=jenkins-hbase20.apache.org/148.251.75.209:37835, startcode=1676689292667 2023-02-18 03:01:32,904 DEBUG [RS:1;jenkins-hbase20:37835] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:32,904 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:01:32,904 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43805 2023-02-18 03:01:32,904 INFO [RS:0;jenkins-hbase20:43805] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:32,905 INFO [RS:0;jenkins-hbase20:43805] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:32,905 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:32,905 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,33089,1676689292572 with isa=jenkins-hbase20.apache.org/148.251.75.209:43805, startcode=1676689292637 2023-02-18 03:01:32,905 DEBUG [RS:0;jenkins-hbase20:43805] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:32,907 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42339, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:32,907 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41793, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:32,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33089] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,909 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,910 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5 2023-02-18 03:01:32,910 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5 2023-02-18 03:01:32,910 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37371 2023-02-18 03:01:32,910 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:32,910 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37371 2023-02-18 03:01:32,910 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:32,913 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:32,913 DEBUG [RS:0;jenkins-hbase20:43805] zookeeper.ZKUtil(162): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,913 DEBUG [RS:1;jenkins-hbase20:37835] zookeeper.ZKUtil(162): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,913 WARN [RS:0;jenkins-hbase20:43805] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:32,913 WARN [RS:1;jenkins-hbase20:37835] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:32,913 INFO [RS:0;jenkins-hbase20:43805] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:32,913 INFO [RS:1;jenkins-hbase20:37835] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:32,913 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,913 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,37835,1676689292667] 2023-02-18 03:01:32,916 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43805,1676689292637] 2023-02-18 03:01:32,919 DEBUG [RS:1;jenkins-hbase20:37835] zookeeper.ZKUtil(162): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,919 DEBUG [RS:0;jenkins-hbase20:43805] zookeeper.ZKUtil(162): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,919 DEBUG [RS:1;jenkins-hbase20:37835] zookeeper.ZKUtil(162): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,919 DEBUG [RS:0;jenkins-hbase20:43805] zookeeper.ZKUtil(162): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,919 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:32,919 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:32,920 INFO [RS:1;jenkins-hbase20:37835] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:32,920 INFO [RS:0;jenkins-hbase20:43805] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:32,923 INFO [RS:1;jenkins-hbase20:37835] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:32,925 INFO [RS:0;jenkins-hbase20:43805] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:32,925 INFO [RS:1;jenkins-hbase20:37835] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:32,925 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,925 INFO [RS:0;jenkins-hbase20:43805] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:32,925 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,925 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:32,926 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:32,927 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,927 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,927 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,927 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:32,928 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:32,928 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:0;jenkins-hbase20:43805] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,928 DEBUG [RS:1;jenkins-hbase20:37835] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:32,929 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,929 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,929 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,929 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,930 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,930 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,939 INFO [RS:1;jenkins-hbase20:37835] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:32,939 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37835,1676689292667-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,943 INFO [RS:0;jenkins-hbase20:43805] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:32,943 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43805,1676689292637-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:32,948 INFO [RS:1;jenkins-hbase20:37835] regionserver.Replication(203): jenkins-hbase20.apache.org,37835,1676689292667 started 2023-02-18 03:01:32,948 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,37835,1676689292667, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:37835, sessionid=0x1017387feb00002 2023-02-18 03:01:32,948 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:32,948 DEBUG [RS:1;jenkins-hbase20:37835] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,948 DEBUG [RS:1;jenkins-hbase20:37835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37835,1676689292667' 2023-02-18 03:01:32,948 DEBUG [RS:1;jenkins-hbase20:37835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,37835,1676689292667' 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:32,949 DEBUG [RS:1;jenkins-hbase20:37835] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:32,949 INFO [RS:1;jenkins-hbase20:37835] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:32,949 INFO [RS:1;jenkins-hbase20:37835] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:32,956 INFO [RS:0;jenkins-hbase20:43805] regionserver.Replication(203): jenkins-hbase20.apache.org,43805,1676689292637 started 2023-02-18 03:01:32,956 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,43805,1676689292637, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43805, sessionid=0x1017387feb00001 2023-02-18 03:01:32,956 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:32,956 DEBUG [RS:0;jenkins-hbase20:43805] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,956 DEBUG [RS:0;jenkins-hbase20:43805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43805,1676689292637' 2023-02-18 03:01:32,956 DEBUG [RS:0;jenkins-hbase20:43805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:32,956 DEBUG [RS:0;jenkins-hbase20:43805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:32,957 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:32,957 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:32,957 DEBUG [RS:0;jenkins-hbase20:43805] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:32,957 DEBUG [RS:0;jenkins-hbase20:43805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43805,1676689292637' 2023-02-18 03:01:32,957 DEBUG [RS:0;jenkins-hbase20:43805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:32,957 DEBUG [RS:0;jenkins-hbase20:43805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:32,958 DEBUG [RS:0;jenkins-hbase20:43805] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:32,958 INFO [RS:0;jenkins-hbase20:43805] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:32,958 INFO [RS:0;jenkins-hbase20:43805] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:33,054 DEBUG [jenkins-hbase20:33089] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:01:33,054 DEBUG [jenkins-hbase20:33089] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:33,056 DEBUG [jenkins-hbase20:33089] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:33,056 DEBUG [jenkins-hbase20:33089] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:33,056 DEBUG [jenkins-hbase20:33089] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:33,056 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37835,1676689292667, state=OPENING 2023-02-18 03:01:33,058 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:01:33,058 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:33,059 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:33,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37835,1676689292667}] 2023-02-18 03:01:33,213 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:33,214 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:33,216 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:33,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:01:33,223 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:33,225 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37835%2C1676689292667.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,37835,1676689292667, archiveDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/oldWALs, maxLogs=32 2023-02-18 03:01:33,242 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK] 2023-02-18 03:01:33,242 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK] 2023-02-18 03:01:33,244 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,37835,1676689292667/jenkins-hbase20.apache.org%2C37835%2C1676689292667.meta.1676689293226.meta 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK], DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK]] 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:01:33,244 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:01:33,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:01:33,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:33,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/info 2023-02-18 03:01:33,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/info 2023-02-18 03:01:33,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:33,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:33,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:33,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:33,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:33,247 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:33,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:33,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:33,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/table 2023-02-18 03:01:33,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/table 2023-02-18 03:01:33,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:33,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:33,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740 2023-02-18 03:01:33,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740 2023-02-18 03:01:33,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:33,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:33,253 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67167451, jitterRate=8.730143308639526E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:33,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:33,253 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689293213 2023-02-18 03:01:33,256 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:01:33,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:01:33,257 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,37835,1676689292667, state=OPEN 2023-02-18 03:01:33,258 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:01:33,258 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:33,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:01:33,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,37835,1676689292667 in 199 msec 2023-02-18 03:01:33,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:01:33,261 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-18 03:01:33,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-18 03:01:33,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689293262, completionTime=-1 2023-02-18 03:01:33,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:01:33,262 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:01:33,265 DEBUG [hconnection-0x478cfb89-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:33,266 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44172, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:33,268 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:01:33,268 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689353268 2023-02-18 03:01:33,268 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689413268 2023-02-18 03:01:33,268 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33089,1676689292572-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33089,1676689292572-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33089,1676689292572-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:33089, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:01:33,291 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:33,293 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:01:33,294 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:01:33,296 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:33,298 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:33,299 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,300 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e empty. 2023-02-18 03:01:33,300 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,300 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:01:33,309 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:33,310 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7fbbc395a641706e339af5bf841e128e, NAME => 'hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp 2023-02-18 03:01:33,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:33,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7fbbc395a641706e339af5bf841e128e, disabling compactions & flushes 2023-02-18 03:01:33,318 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. after waiting 0 ms 2023-02-18 03:01:33,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,318 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7fbbc395a641706e339af5bf841e128e: 2023-02-18 03:01:33,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:33,322 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689293321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689293321"}]},"ts":"1676689293321"} 2023-02-18 03:01:33,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:33,324 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:33,324 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689293324"}]},"ts":"1676689293324"} 2023-02-18 03:01:33,325 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:01:33,327 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:33,328 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:33,328 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:33,328 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:33,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7fbbc395a641706e339af5bf841e128e, ASSIGN}] 2023-02-18 03:01:33,330 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7fbbc395a641706e339af5bf841e128e, ASSIGN 2023-02-18 03:01:33,331 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7fbbc395a641706e339af5bf841e128e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43805,1676689292637; forceNewPlan=false, retain=false 2023-02-18 03:01:33,481 INFO [jenkins-hbase20:33089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:33,482 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7fbbc395a641706e339af5bf841e128e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:33,482 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689293482"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689293482"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689293482"}]},"ts":"1676689293482"} 2023-02-18 03:01:33,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7fbbc395a641706e339af5bf841e128e, server=jenkins-hbase20.apache.org,43805,1676689292637}] 2023-02-18 03:01:33,642 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:33,643 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:33,646 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:33,652 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,654 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43805%2C1676689292637, suffix=, logDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,43805,1676689292637, archiveDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/oldWALs, maxLogs=32 2023-02-18 03:01:33,669 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK] 2023-02-18 03:01:33,671 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK] 2023-02-18 03:01:33,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,43805,1676689292637/jenkins-hbase20.apache.org%2C43805%2C1676689292637.1676689293654 2023-02-18 03:01:33,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK], DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK]] 2023-02-18 03:01:33,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7fbbc395a641706e339af5bf841e128e, NAME => 'hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:33,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:33,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,677 INFO [StoreOpener-7fbbc395a641706e339af5bf841e128e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,679 DEBUG [StoreOpener-7fbbc395a641706e339af5bf841e128e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/info 2023-02-18 03:01:33,679 DEBUG [StoreOpener-7fbbc395a641706e339af5bf841e128e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/info 2023-02-18 03:01:33,679 INFO [StoreOpener-7fbbc395a641706e339af5bf841e128e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fbbc395a641706e339af5bf841e128e columnFamilyName info 2023-02-18 03:01:33,679 INFO [StoreOpener-7fbbc395a641706e339af5bf841e128e-1] regionserver.HStore(310): Store=7fbbc395a641706e339af5bf841e128e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:33,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,680 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:33,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:33,683 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7fbbc395a641706e339af5bf841e128e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71203535, jitterRate=0.061015352606773376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:33,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7fbbc395a641706e339af5bf841e128e: 2023-02-18 03:01:33,684 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e., pid=6, masterSystemTime=1676689293642 2023-02-18 03:01:33,686 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,687 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:33,687 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7fbbc395a641706e339af5bf841e128e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:33,687 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689293687"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689293687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689293687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689293687"}]},"ts":"1676689293687"} 2023-02-18 03:01:33,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:01:33,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7fbbc395a641706e339af5bf841e128e, server=jenkins-hbase20.apache.org,43805,1676689292637 in 203 msec 2023-02-18 03:01:33,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:01:33,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7fbbc395a641706e339af5bf841e128e, ASSIGN in 362 msec 2023-02-18 03:01:33,692 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:33,692 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689293692"}]},"ts":"1676689293692"} 2023-02-18 03:01:33,693 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:01:33,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:01:33,695 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:33,695 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:33,695 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:33,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 404 msec 2023-02-18 03:01:33,697 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:33,698 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58280, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:33,700 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:01:33,706 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:33,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-18 03:01:33,711 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:01:33,722 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:33,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-18 03:01:33,738 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:01:33,739 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:01:33,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 1.045sec 2023-02-18 03:01:33,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:01:33,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:01:33,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:01:33,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33089,1676689292572-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:01:33,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33089,1676689292572-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:01:33,742 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:01:33,788 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ReadOnlyZKClient(139): Connect 0x1ad8c14f to 127.0.0.1:64473 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:33,794 DEBUG [Listener at localhost.localdomain/34401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c000b2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:33,797 DEBUG [hconnection-0x3c6b1580-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:33,801 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:33,803 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:33,803 DEBUG [Listener at localhost.localdomain/34401] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:01:33,806 DEBUG [Listener at localhost.localdomain/34401] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:01:33,808 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:01:33,808 INFO [Listener at localhost.localdomain/34401] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:33,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:01:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 148.251.75.209:54652 deadline: 1676689353809, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:33,810 INFO [Listener at localhost.localdomain/34401] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 03:01:33,813 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:33,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:33,816 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:33,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-18 03:01:33,817 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:33,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:33,818 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:33,819 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a empty. 2023-02-18 03:01:33,819 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:33,819 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-18 03:01:33,831 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:33,832 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => bed1a9e24551c56436243907d3f8ef4a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp 2023-02-18 03:01:33,841 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:33,841 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing bed1a9e24551c56436243907d3f8ef4a, disabling compactions & flushes 2023-02-18 03:01:33,841 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:33,841 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:33,841 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. after waiting 0 ms 2023-02-18 03:01:33,841 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:33,841 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:33,841 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for bed1a9e24551c56436243907d3f8ef4a: 2023-02-18 03:01:33,843 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:33,844 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676689293844"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689293844"}]},"ts":"1676689293844"} 2023-02-18 03:01:33,845 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:33,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:33,846 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689293846"}]},"ts":"1676689293846"} 2023-02-18 03:01:33,847 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-18 03:01:33,849 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:33,850 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:33,850 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:33,850 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:33,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, ASSIGN}] 2023-02-18 03:01:33,852 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, ASSIGN 2023-02-18 03:01:33,853 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,37835,1676689292667; forceNewPlan=false, retain=false 2023-02-18 03:01:33,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:33,951 INFO [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37835%2C1676689292667, suffix=, logDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,37835,1676689292667, archiveDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/oldWALs, maxLogs=32 2023-02-18 03:01:33,961 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK] 2023-02-18 03:01:33,961 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK] 2023-02-18 03:01:33,963 INFO [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,37835,1676689292667/jenkins-hbase20.apache.org%2C37835%2C1676689292667.1676689293951 2023-02-18 03:01:33,963 DEBUG [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46403,DS-e5f427f5-6ee7-4d4e-b3cb-b60cd1a69ca6,DISK], DatanodeInfoWithStorage[127.0.0.1:34771,DS-5cdc2e0f-7d9c-4c08-a9df-410fa94f6bc7,DISK]] 2023-02-18 03:01:34,003 INFO [jenkins-hbase20:33089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:34,003 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bed1a9e24551c56436243907d3f8ef4a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,003 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676689294003"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689294003"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689294003"}]},"ts":"1676689294003"} 2023-02-18 03:01:34,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bed1a9e24551c56436243907d3f8ef4a, server=jenkins-hbase20.apache.org,37835,1676689292667}] 2023-02-18 03:01:34,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:34,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bed1a9e24551c56436243907d3f8ef4a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,163 INFO [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,165 DEBUG [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1 2023-02-18 03:01:34,165 DEBUG [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1 2023-02-18 03:01:34,166 INFO [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bed1a9e24551c56436243907d3f8ef4a columnFamilyName f1 2023-02-18 03:01:34,166 INFO [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] regionserver.HStore(310): Store=bed1a9e24551c56436243907d3f8ef4a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:34,166 INFO [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,169 DEBUG [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2 2023-02-18 03:01:34,169 DEBUG [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2 2023-02-18 03:01:34,169 INFO [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bed1a9e24551c56436243907d3f8ef4a columnFamilyName f2 2023-02-18 03:01:34,170 INFO [StoreOpener-bed1a9e24551c56436243907d3f8ef4a-1] regionserver.HStore(310): Store=bed1a9e24551c56436243907d3f8ef4a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:34,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:34,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:34,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:34,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened bed1a9e24551c56436243907d3f8ef4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69439222, jitterRate=0.034725040197372437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:34,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for bed1a9e24551c56436243907d3f8ef4a: 2023-02-18 03:01:34,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a., pid=12, masterSystemTime=1676689294157 2023-02-18 03:01:34,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,181 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bed1a9e24551c56436243907d3f8ef4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,181 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676689294181"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689294181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689294181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689294181"}]},"ts":"1676689294181"} 2023-02-18 03:01:34,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 03:01:34,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bed1a9e24551c56436243907d3f8ef4a, server=jenkins-hbase20.apache.org,37835,1676689292667 in 177 msec 2023-02-18 03:01:34,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 03:01:34,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, ASSIGN in 334 msec 2023-02-18 03:01:34,187 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:34,187 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689294187"}]},"ts":"1676689294187"} 2023-02-18 03:01:34,189 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-18 03:01:34,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:34,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 378 msec 2023-02-18 03:01:34,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:34,421 INFO [Listener at localhost.localdomain/34401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-18 03:01:34,421 DEBUG [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-18 03:01:34,422 INFO [Listener at localhost.localdomain/34401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:34,423 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-18 03:01:34,424 INFO [Listener at localhost.localdomain/34401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:34,424 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-18 03:01:34,424 INFO [Listener at localhost.localdomain/34401] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:01:34,458 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37835] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,549 INFO [Listener at localhost.localdomain/34401] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:01:34,549 INFO [Listener at localhost.localdomain/34401] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:01:34,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 03:01:34,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689294550 (current time:1676689294550). 2023-02-18 03:01:34,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:01:34,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] zookeeper.ReadOnlyZKClient(139): Connect 0x3cfb08e8 to 127.0.0.1:64473 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:34,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6742397, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:34,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:34,555 INFO [RS-EventLoopGroup-20-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58468, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cfb08e8 to 127.0.0.1:64473 2023-02-18 03:01:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:34,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:01:34,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 03:01:34,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 03:01:34,560 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 03:01:34,561 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676689894561 2023-02-18 03:01:34,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-18 03:01:34,561 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:34,563 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-18 03:01:34,563 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:34,563 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:01:34,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 03:01:34,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-18 03:01:34,564 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 03:01:34,565 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676689894565 2023-02-18 03:01:34,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-18 03:01:34,577 INFO [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-18 03:01:34,577 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:34,578 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-18 03:01:34,578 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-18 03:01:34,579 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,579 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,579 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:34,579 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:34,579 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:34,580 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,580 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:34,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 03:01:34,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-18 03:01:34,581 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 03:01:34,581 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:34,581 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-18 03:01:34,582 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:34,583 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 03:01:34,583 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-18 03:01:34,583 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 03:01:34,583 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-18 03:01:34,583 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37835,1676689292667' joining acquired barrier for procedure (foo) in zk 2023-02-18 03:01:34,583 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43805,1676689292637' joining acquired barrier for procedure (foo) in zk 2023-02-18 03:01:34,584 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,584 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:34,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:34,584 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,584 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,584 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:34,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:34,584 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,584 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37835,1676689292667' joining acquired barrier for procedure 'foo' on coordinator 2023-02-18 03:01:34,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@488f8bef[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:34,585 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-18 03:01:34,586 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 03:01:34,586 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,586 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 03:01:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-18 03:01:34,586 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,43805,1676689292637' in zk 2023-02-18 03:01:34,587 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 03:01:34,587 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:34,587 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,587 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. started... 2023-02-18 03:01:34,587 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bed1a9e24551c56436243907d3f8ef4a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 03:01:34,587 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 03:01:34,587 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:34,587 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 03:01:34,602 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f1/347cb9c4f0c9472ca2f7e1be22111e6b 2023-02-18 03:01:34,618 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f2/64a990cbb4424f74a853b405724cbfe0 2023-02-18 03:01:34,622 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f1/347cb9c4f0c9472ca2f7e1be22111e6b as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b 2023-02-18 03:01:34,625 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:34,626 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f2/64a990cbb4424f74a853b405724cbfe0 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0 2023-02-18 03:01:34,629 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:34,630 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bed1a9e24551c56436243907d3f8ef4a in 43ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bed1a9e24551c56436243907d3f8ef4a: 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.' region-info for snapshot=foo 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b] hfiles 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b for snapshot=foo 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0] hfiles 2023-02-18 03:01:34,630 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0 for snapshot=foo 2023-02-18 03:01:34,635 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. completed. 2023-02-18 03:01:34,635 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,635 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 03:01:34,635 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 03:01:34,635 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,635 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-18 03:01:34,635 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase20.apache.org,37835,1676689292667' in zk 2023-02-18 03:01:34,636 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-18 03:01:34,636 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,636 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:34,636 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-18 03:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase20.apache.org,37835,1676689292667': 2023-02-18 03:01:34,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37835,1676689292667' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-18 03:01:34,638 INFO [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-18 03:01:34,638 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:34,638 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:34,638 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-18 03:01:34,638 INFO [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:01:34,639 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:34,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:34,640 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:34,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:34,640 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,641 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,641 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:34,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-18 03:01:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-18 03:01:34,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:34,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:34,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:34,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-18 03:01:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:34,644 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-18 03:01:34,644 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-18 03:01:34,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:34,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.hbase-snapshot/.tmp/foo 2023-02-18 03:01:34,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:34,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:34,663 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:34,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-18 03:01:34,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:34,664 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:01:34,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.hbase-snapshot/.tmp/foo to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.hbase-snapshot/foo 2023-02-18 03:01:34,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-18 03:01:34,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.hbase-snapshot/.tmp/foo 2023-02-18 03:01:34,684 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.hbase-snapshot/.tmp/foo 2023-02-18 03:01:34,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676689294561Consolidate snapshot: foo at 1676689294644 (+83 ms)Loading Region manifests for foo at 1676689294644Writing data manifest for foo at 1676689294646 (+2 ms)Verifying snapshot: foo at 1676689294657 (+11 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676689294684 (+27 ms) 2023-02-18 03:01:34,688 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-18 03:01:34,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 127 msec 2023-02-18 03:01:34,865 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:34,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-18 03:01:34,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:34,867 INFO [Listener at localhost.localdomain/34401] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:34,875 INFO [Listener at localhost.localdomain/34401] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:34,883 INFO [Listener at localhost.localdomain/34401] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:34,913 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37835] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:34,990 INFO [Listener at localhost.localdomain/34401] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:34,995 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:34,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:34,997 INFO [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 03:01:34,997 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:34,998 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-18 03:01:34,998 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-18 03:01:34,998 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:34,998 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:34,999 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,999 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:34,999 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:34,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:34,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:34,999 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:34,999 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:34,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,000 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-18 03:01:35,000 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:35,000 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-18 03:01:35,001 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-18 03:01:35,001 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:35,001 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 03:01:35,002 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,002 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:35,002 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-18 03:01:35,002 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-18 03:01:35,002 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43805,1676689292637' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-18 03:01:35,002 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. started... 2023-02-18 03:01:35,002 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bed1a9e24551c56436243907d3f8ef4a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 03:01:35,003 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,003 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,003 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:35,017 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f1/3a062a1ff8504422a4a12ec1c4988b81 2023-02-18 03:01:35,035 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f2/858de0b08f1344b1b15193b0b0437313 2023-02-18 03:01:35,039 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f1/3a062a1ff8504422a4a12ec1c4988b81 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/3a062a1ff8504422a4a12ec1c4988b81 2023-02-18 03:01:35,043 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/3a062a1ff8504422a4a12ec1c4988b81, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:35,044 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/.tmp/f2/858de0b08f1344b1b15193b0b0437313 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/858de0b08f1344b1b15193b0b0437313 2023-02-18 03:01:35,048 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/858de0b08f1344b1b15193b0b0437313, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:35,048 INFO [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bed1a9e24551c56436243907d3f8ef4a in 46ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:35,049 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bed1a9e24551c56436243907d3f8ef4a: 2023-02-18 03:01:35,049 DEBUG [rs(jenkins-hbase20.apache.org,37835,1676689292667)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,049 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 03:01:35,050 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 03:01:35,050 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,050 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-18 03:01:35,050 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,37835,1676689292667' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-18 03:01:35,051 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,051 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:35,051 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,051 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:35,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:35,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,37835,1676689292667' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-18 03:01:35,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cb01626[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:35,053 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-18 03:01:35,053 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,054 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-18 03:01:35,054 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,054 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:35,054 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-18 03:01:35,055 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,37835,1676689292667' in zk 2023-02-18 03:01:35,054 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-18 03:01:35,055 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-18 03:01:35,055 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase20.apache.org,43805,1676689292637' in zk 2023-02-18 03:01:35,055 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,055 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-18 03:01:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:35,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:35,055 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:35,055 DEBUG [member: 'jenkins-hbase20.apache.org,37835,1676689292667' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-18 03:01:35,056 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-18 03:01:35,056 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:35,056 DEBUG [member: 'jenkins-hbase20.apache.org,43805,1676689292637' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-18 03:01:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase20.apache.org,37835,1676689292667': 2023-02-18 03:01:35,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,37835,1676689292667' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-18 03:01:35,057 INFO [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-18 03:01:35,057 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:35,057 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:35,057 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,057 INFO [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:35,058 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,058 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:35,058 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:35,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,058 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,059 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:35,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:35,059 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:35,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,059 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:35,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:35,060 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,061 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:35,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:35,062 DEBUG [(jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:35,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-18 03:01:35,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:35,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:35,062 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,063 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:35,063 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:35,063 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:35,063 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:35,063 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:35,163 DEBUG [Listener at localhost.localdomain/34401] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:35,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:35,168 INFO [Listener at localhost.localdomain/34401] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676689294550 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:35,168 DEBUG [Listener at localhost.localdomain/34401] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:37371/user/jenkins/test-data/e0b10c1c-25b5-f18a-a1d0-b3ac9dc910c6/foo/64e28298-3048-4b26-b8f1-26dc73a903ce/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,169 INFO [Listener at localhost.localdomain/34401] snapshot.RestoreSnapshotHelper(239): region to add: bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:35,169 INFO [Listener at localhost.localdomain/34401] snapshot.RestoreSnapshotHelper(585): clone region=bed1a9e24551c56436243907d3f8ef4a as bed1a9e24551c56436243907d3f8ef4a in snapshot foo 2023-02-18 03:01:35,169 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bed1a9e24551c56436243907d3f8ef4a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37371/user/jenkins/test-data/e0b10c1c-25b5-f18a-a1d0-b3ac9dc910c6/foo/64e28298-3048-4b26-b8f1-26dc73a903ce 2023-02-18 03:01:35,174 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:35,175 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 347cb9c4f0c9472ca2f7e1be22111e6b from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,176 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 64a990cbb4424f74a853b405724cbfe0 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,178 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bed1a9e24551c56436243907d3f8ef4a, disabling compactions & flushes 2023-02-18 03:01:35,178 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,178 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,178 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. after waiting 0 ms 2023-02-18 03:01:35,178 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,178 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,178 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bed1a9e24551c56436243907d3f8ef4a: 2023-02-18 03:01:35,181 INFO [Listener at localhost.localdomain/34401] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676689294550 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:35,181 DEBUG [Listener at localhost.localdomain/34401] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:37371/user/jenkins/test-data/e0b10c1c-25b5-f18a-a1d0-b3ac9dc910c6/foo/64e28298-3048-4b26-b8f1-26dc73a903ce 2023-02-18 03:01:35,181 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:37371/user/jenkins/test-data/e0b10c1c-25b5-f18a-a1d0-b3ac9dc910c6/foo/64e28298-3048-4b26-b8f1-26dc73a903ce 2023-02-18 03:01:35,181 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:35,182 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:35,182 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-18 03:01:35,182 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(699): |----------bed1a9e24551c56436243907d3f8ef4a/ 2023-02-18 03:01:35,182 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:35,183 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:35,183 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=bed1a9e24551c56436243907d3f8ef4a-347cb9c4f0c9472ca2f7e1be22111e6b 2023-02-18 03:01:35,183 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:35,183 DEBUG [Listener at localhost.localdomain/34401] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=bed1a9e24551c56436243907d3f8ef4a-64a990cbb4424f74a853b405724cbfe0 hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/3a062a1ff8504422a4a12ec1c4988b81 hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0 hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/858de0b08f1344b1b15193b0b0437313 2023-02-18 03:01:35,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "foo" 2023-02-18 03:01:35,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-18 03:01:35,192 INFO [Listener at localhost.localdomain/34401] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689295195"}]},"ts":"1676689295195"} 2023-02-18 03:01:35,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:35,196 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-18 03:01:35,197 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-18 03:01:35,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, UNASSIGN}] 2023-02-18 03:01:35,197 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, UNASSIGN 2023-02-18 03:01:35,198 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bed1a9e24551c56436243907d3f8ef4a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676689295198"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689295198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689295198"}]},"ts":"1676689295198"} 2023-02-18 03:01:35,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bed1a9e24551c56436243907d3f8ef4a, server=jenkins-hbase20.apache.org,37835,1676689292667}] 2023-02-18 03:01:35,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:35,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:35,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing bed1a9e24551c56436243907d3f8ef4a, disabling compactions & flushes 2023-02-18 03:01:35,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. after waiting 0 ms 2023-02-18 03:01:35,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:35,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a. 2023-02-18 03:01:35,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for bed1a9e24551c56436243907d3f8ef4a: 2023-02-18 03:01:35,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:35,361 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bed1a9e24551c56436243907d3f8ef4a, regionState=CLOSED 2023-02-18 03:01:35,361 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676689295361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689295361"}]},"ts":"1676689295361"} 2023-02-18 03:01:35,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 03:01:35,366 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bed1a9e24551c56436243907d3f8ef4a, server=jenkins-hbase20.apache.org,37835,1676689292667 in 165 msec 2023-02-18 03:01:35,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 03:01:35,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=bed1a9e24551c56436243907d3f8ef4a, UNASSIGN in 169 msec 2023-02-18 03:01:35,370 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689295370"}]},"ts":"1676689295370"} 2023-02-18 03:01:35,372 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-18 03:01:35,373 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-18 03:01:35,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 182 msec 2023-02-18 03:01:35,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:35,502 INFO [Listener at localhost.localdomain/34401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-18 03:01:35,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,506 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,506 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:35,509 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:35,510 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1, FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2, FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/recovered.edits] 2023-02-18 03:01:35,513 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/347cb9c4f0c9472ca2f7e1be22111e6b 2023-02-18 03:01:35,514 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/3a062a1ff8504422a4a12ec1c4988b81 to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f1/3a062a1ff8504422a4a12ec1c4988b81 2023-02-18 03:01:35,517 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0 to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/64a990cbb4424f74a853b405724cbfe0 2023-02-18 03:01:35,518 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/858de0b08f1344b1b15193b0b0437313 to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/f2/858de0b08f1344b1b15193b0b0437313 2023-02-18 03:01:35,522 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/recovered.edits/12.seqid to hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a/recovered.edits/12.seqid 2023-02-18 03:01:35,523 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/bed1a9e24551c56436243907d3f8ef4a 2023-02-18 03:01:35,523 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-18 03:01:35,525 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,526 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-18 03:01:35,528 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-18 03:01:35,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,532 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-18 03:01:35,532 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689295532"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:35,533 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 03:01:35,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bed1a9e24551c56436243907d3f8ef4a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676689293813.bed1a9e24551c56436243907d3f8ef4a.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 03:01:35,533 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-18 03:01:35,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676689295533"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:35,535 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-18 03:01:35,536 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-18 03:01:35,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-18 03:01:35,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:35,608 INFO [Listener at localhost.localdomain/34401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-18 03:01:35,608 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:35,608 INFO [Listener at localhost.localdomain/34401] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:35,608 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ad8c14f to 127.0.0.1:64473 2023-02-18 03:01:35,608 DEBUG [Listener at localhost.localdomain/34401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,609 DEBUG [Listener at localhost.localdomain/34401] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:35,609 DEBUG [Listener at localhost.localdomain/34401] util.JVMClusterUtil(257): Found active master hash=1739621749, stopped=false 2023-02-18 03:01:35,609 INFO [Listener at localhost.localdomain/34401] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:35,609 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:35,609 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:35,609 INFO [Listener at localhost.localdomain/34401] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:35,610 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:35,609 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:35,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:35,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:35,612 DEBUG [Listener at localhost.localdomain/34401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40506d6b to 127.0.0.1:64473 2023-02-18 03:01:35,612 DEBUG [Listener at localhost.localdomain/34401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:35,612 INFO [Listener at localhost.localdomain/34401] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,43805,1676689292637' ***** 2023-02-18 03:01:35,612 INFO [Listener at localhost.localdomain/34401] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:35,612 INFO [Listener at localhost.localdomain/34401] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,37835,1676689292667' ***** 2023-02-18 03:01:35,612 INFO [Listener at localhost.localdomain/34401] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:35,612 INFO [RS:0;jenkins-hbase20:43805] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:35,612 INFO [RS:1;jenkins-hbase20:37835] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:35,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:35,612 INFO [RS:1;jenkins-hbase20:37835] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:35,612 INFO [RS:0;jenkins-hbase20:43805] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:35,613 INFO [RS:1;jenkins-hbase20:37835] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:35,612 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:35,613 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,613 INFO [RS:0;jenkins-hbase20:43805] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:35,614 DEBUG [RS:1;jenkins-hbase20:37835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b9906aa to 127.0.0.1:64473 2023-02-18 03:01:35,614 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(3304): Received CLOSE for 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:35,614 DEBUG [RS:1;jenkins-hbase20:37835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,614 INFO [RS:1;jenkins-hbase20:37835] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:35,614 INFO [RS:1;jenkins-hbase20:37835] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:35,614 INFO [RS:1;jenkins-hbase20:37835] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:35,614 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,614 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:35,614 DEBUG [RS:0;jenkins-hbase20:43805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f3d4787 to 127.0.0.1:64473 2023-02-18 03:01:35,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7fbbc395a641706e339af5bf841e128e, disabling compactions & flushes 2023-02-18 03:01:35,614 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 03:01:35,614 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:35,614 DEBUG [RS:0;jenkins-hbase20:43805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:35,614 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-18 03:01:35,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:35,615 DEBUG [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-18 03:01:35,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:35,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:35,615 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-18 03:01:35,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:35,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. after waiting 0 ms 2023-02-18 03:01:35,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:35,615 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1479): Online Regions={7fbbc395a641706e339af5bf841e128e=hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e.} 2023-02-18 03:01:35,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.47 KB heapSize=7.87 KB 2023-02-18 03:01:35,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:35,615 DEBUG [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1505): Waiting on 7fbbc395a641706e339af5bf841e128e 2023-02-18 03:01:35,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 7fbbc395a641706e339af5bf841e128e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:35,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/.tmp/info/42a55b699a9440898d8f43fde95be4d3 2023-02-18 03:01:35,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/.tmp/info/42a55b699a9440898d8f43fde95be4d3 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/info/42a55b699a9440898d8f43fde95be4d3 2023-02-18 03:01:35,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/.tmp/info/6b6b1483633d49d1b9ffca46f44656d5 2023-02-18 03:01:35,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/info/42a55b699a9440898d8f43fde95be4d3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:35,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b6b1483633d49d1b9ffca46f44656d5 2023-02-18 03:01:35,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7fbbc395a641706e339af5bf841e128e in 16ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:35,633 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:35,634 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:35,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/namespace/7fbbc395a641706e339af5bf841e128e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:35,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:35,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7fbbc395a641706e339af5bf841e128e: 2023-02-18 03:01:35,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689293291.7fbbc395a641706e339af5bf841e128e. 2023-02-18 03:01:35,639 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/.tmp/rep_barrier/7aa8961437034015a1c269af806fadaf 2023-02-18 03:01:35,642 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aa8961437034015a1c269af806fadaf 2023-02-18 03:01:35,648 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/.tmp/table/cfa13db2571f4561b15a757d39d077a4 2023-02-18 03:01:35,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfa13db2571f4561b15a757d39d077a4 2023-02-18 03:01:35,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/.tmp/info/6b6b1483633d49d1b9ffca46f44656d5 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/info/6b6b1483633d49d1b9ffca46f44656d5 2023-02-18 03:01:35,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b6b1483633d49d1b9ffca46f44656d5 2023-02-18 03:01:35,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/info/6b6b1483633d49d1b9ffca46f44656d5, entries=12, sequenceid=21, filesize=6.3 K 2023-02-18 03:01:35,655 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/.tmp/rep_barrier/7aa8961437034015a1c269af806fadaf as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/rep_barrier/7aa8961437034015a1c269af806fadaf 2023-02-18 03:01:35,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7aa8961437034015a1c269af806fadaf 2023-02-18 03:01:35,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/rep_barrier/7aa8961437034015a1c269af806fadaf, entries=1, sequenceid=21, filesize=5.1 K 2023-02-18 03:01:35,659 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/.tmp/table/cfa13db2571f4561b15a757d39d077a4 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/table/cfa13db2571f4561b15a757d39d077a4 2023-02-18 03:01:35,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfa13db2571f4561b15a757d39d077a4 2023-02-18 03:01:35,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/table/cfa13db2571f4561b15a757d39d077a4, entries=4, sequenceid=21, filesize=5.1 K 2023-02-18 03:01:35,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.47 KB/4577, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 48ms, sequenceid=21, compaction requested=false 2023-02-18 03:01:35,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 03:01:35,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:35,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:35,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:35,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:35,815 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,37835,1676689292667; all regions closed. 2023-02-18 03:01:35,815 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,43805,1676689292637; all regions closed. 2023-02-18 03:01:35,818 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/WALs/jenkins-hbase20.apache.org,43805,1676689292637/jenkins-hbase20.apache.org%2C43805%2C1676689292637.1676689293654 not finished, retry = 0 2023-02-18 03:01:35,820 DEBUG [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/oldWALs 2023-02-18 03:01:35,820 INFO [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37835%2C1676689292667.meta:.meta(num 1676689293226) 2023-02-18 03:01:35,828 DEBUG [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/oldWALs 2023-02-18 03:01:35,828 INFO [RS:1;jenkins-hbase20:37835] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C37835%2C1676689292667:(num 1676689293951) 2023-02-18 03:01:35,828 DEBUG [RS:1;jenkins-hbase20:37835] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,828 INFO [RS:1;jenkins-hbase20:37835] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:35,829 INFO [RS:1;jenkins-hbase20:37835] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:35,829 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:35,830 INFO [RS:1;jenkins-hbase20:37835] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37835 2023-02-18 03:01:35,831 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,831 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,37835,1676689292667 2023-02-18 03:01:35,831 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:35,831 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:35,831 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2af38c73 rejected from java.util.concurrent.ThreadPoolExecutor@2ecc0df5[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:35,831 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:35,831 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cc9c5fa rejected from java.util.concurrent.ThreadPoolExecutor@2ecc0df5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:35,832 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,37835,1676689292667] 2023-02-18 03:01:35,832 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,37835,1676689292667; numProcessing=1 2023-02-18 03:01:35,833 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,37835,1676689292667 already deleted, retry=false 2023-02-18 03:01:35,833 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,37835,1676689292667 expired; onlineServers=1 2023-02-18 03:01:35,920 DEBUG [RS:0;jenkins-hbase20:43805] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/oldWALs 2023-02-18 03:01:35,920 INFO [RS:0;jenkins-hbase20:43805] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43805%2C1676689292637:(num 1676689293654) 2023-02-18 03:01:35,920 DEBUG [RS:0;jenkins-hbase20:43805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,920 INFO [RS:0;jenkins-hbase20:43805] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:35,921 INFO [RS:0;jenkins-hbase20:43805] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:35,921 INFO [RS:0;jenkins-hbase20:43805] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:35,921 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:35,921 INFO [RS:0;jenkins-hbase20:43805] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:35,921 INFO [RS:0;jenkins-hbase20:43805] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:35,922 INFO [RS:0;jenkins-hbase20:43805] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43805 2023-02-18 03:01:35,923 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43805,1676689292637 2023-02-18 03:01:35,923 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:35,923 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43805,1676689292637] 2023-02-18 03:01:35,923 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43805,1676689292637; numProcessing=2 2023-02-18 03:01:35,924 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43805,1676689292637 already deleted, retry=false 2023-02-18 03:01:35,924 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,43805,1676689292637 expired; onlineServers=0 2023-02-18 03:01:35,924 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33089,1676689292572' ***** 2023-02-18 03:01:35,924 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:35,925 DEBUG [M:0;jenkins-hbase20:33089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@638f1d5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:35,925 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33089,1676689292572 2023-02-18 03:01:35,925 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33089,1676689292572; all regions closed. 2023-02-18 03:01:35,925 DEBUG [M:0;jenkins-hbase20:33089] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:35,925 DEBUG [M:0;jenkins-hbase20:33089] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:35,925 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:35,925 DEBUG [M:0;jenkins-hbase20:33089] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:35,925 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689292871] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689292871,5,FailOnTimeoutGroup] 2023-02-18 03:01:35,925 INFO [M:0;jenkins-hbase20:33089] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:35,925 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689292871] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689292871,5,FailOnTimeoutGroup] 2023-02-18 03:01:35,926 INFO [M:0;jenkins-hbase20:33089] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:35,926 INFO [M:0;jenkins-hbase20:33089] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:35,926 DEBUG [M:0;jenkins-hbase20:33089] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:35,926 INFO [M:0;jenkins-hbase20:33089] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:35,927 ERROR [M:0;jenkins-hbase20:33089] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 03:01:35,927 INFO [M:0;jenkins-hbase20:33089] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:35,927 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:35,933 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:35,933 DEBUG [M:0;jenkins-hbase20:33089] zookeeper.ZKUtil(398): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:35,933 WARN [M:0;jenkins-hbase20:33089] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:35,933 INFO [M:0;jenkins-hbase20:33089] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:35,933 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:35,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:35,934 INFO [M:0;jenkins-hbase20:33089] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:35,934 DEBUG [M:0;jenkins-hbase20:33089] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:35,934 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:35,934 DEBUG [M:0;jenkins-hbase20:33089] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:35,934 DEBUG [M:0;jenkins-hbase20:33089] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:35,934 DEBUG [M:0;jenkins-hbase20:33089] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:35,934 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.72 KB heapSize=67.70 KB 2023-02-18 03:01:35,947 INFO [M:0;jenkins-hbase20:33089] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.72 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/18ec9643aa48405d801cd86a3fdd3c43 2023-02-18 03:01:35,951 DEBUG [M:0;jenkins-hbase20:33089] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/18ec9643aa48405d801cd86a3fdd3c43 as hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/18ec9643aa48405d801cd86a3fdd3c43 2023-02-18 03:01:35,959 INFO [M:0;jenkins-hbase20:33089] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37371/user/jenkins/test-data/c1567702-b699-8c60-17ec-c402c8ac71d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/18ec9643aa48405d801cd86a3fdd3c43, entries=17, sequenceid=132, filesize=8.7 K 2023-02-18 03:01:35,960 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegion(2947): Finished flush of dataSize ~56.72 KB/58078, heapSize ~67.68 KB/69304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=132, compaction requested=false 2023-02-18 03:01:35,960 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:35,960 DEBUG [M:0;jenkins-hbase20:33089] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:35,962 INFO [M:0;jenkins-hbase20:33089] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:35,962 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:35,963 INFO [M:0;jenkins-hbase20:33089] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33089 2023-02-18 03:01:35,964 DEBUG [M:0;jenkins-hbase20:33089] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,33089,1676689292572 already deleted, retry=false 2023-02-18 03:01:36,111 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:36,112 INFO [M:0;jenkins-hbase20:33089] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33089,1676689292572; zookeeper connection closed. 2023-02-18 03:01:36,112 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71f2cbb4 rejected from java.util.concurrent.ThreadPoolExecutor@75cd4152[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:36,114 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): master:33089-0x1017387feb00000, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:36,114 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@66fd998e rejected from java.util.concurrent.ThreadPoolExecutor@75cd4152[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:36,212 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:36,212 INFO [RS:0;jenkins-hbase20:43805] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,43805,1676689292637; zookeeper connection closed. 2023-02-18 03:01:36,212 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d4aa2c4 rejected from java.util.concurrent.ThreadPoolExecutor@49753fb5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:36,213 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5dfcf8df] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5dfcf8df 2023-02-18 03:01:36,213 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:43805-0x1017387feb00001, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:36,213 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2575eec8 rejected from java.util.concurrent.ThreadPoolExecutor@49753fb5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:36,312 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:36,313 INFO [RS:1;jenkins-hbase20:37835] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,37835,1676689292667; zookeeper connection closed. 2023-02-18 03:01:36,313 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14025109 rejected from java.util.concurrent.ThreadPoolExecutor@2ecc0df5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:36,313 DEBUG [Listener at localhost.localdomain/34401-EventThread] zookeeper.ZKWatcher(600): regionserver:37835-0x1017387feb00002, quorum=127.0.0.1:64473, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:36,313 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@f3337c1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@f3337c1 2023-02-18 03:01:36,314 ERROR [Listener at localhost.localdomain/34401-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29259b94 rejected from java.util.concurrent.ThreadPoolExecutor@2ecc0df5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:36,314 INFO [Listener at localhost.localdomain/34401] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:36,315 WARN [Listener at localhost.localdomain/34401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:36,322 INFO [Listener at localhost.localdomain/34401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:36,425 WARN [BP-735959230-148.251.75.209-1676689292034 heartbeating to localhost.localdomain/127.0.0.1:37371] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:36,429 WARN [BP-735959230-148.251.75.209-1676689292034 heartbeating to localhost.localdomain/127.0.0.1:37371] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735959230-148.251.75.209-1676689292034 (Datanode Uuid 2035fc6d-41b9-4607-b0a4-59c6b82547a6) service to localhost.localdomain/127.0.0.1:37371 2023-02-18 03:01:36,429 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/dfs/data/data3/current/BP-735959230-148.251.75.209-1676689292034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:36,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/dfs/data/data4/current/BP-735959230-148.251.75.209-1676689292034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:36,431 WARN [Listener at localhost.localdomain/34401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:36,435 INFO [Listener at localhost.localdomain/34401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:36,436 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-18 03:01:36,539 WARN [BP-735959230-148.251.75.209-1676689292034 heartbeating to localhost.localdomain/127.0.0.1:37371] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:36,539 WARN [BP-735959230-148.251.75.209-1676689292034 heartbeating to localhost.localdomain/127.0.0.1:37371] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735959230-148.251.75.209-1676689292034 (Datanode Uuid 4d191810-ece1-4581-93f3-d2b06c922fcb) service to localhost.localdomain/127.0.0.1:37371 2023-02-18 03:01:36,539 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/dfs/data/data1/current/BP-735959230-148.251.75.209-1676689292034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:36,540 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/cluster_07fcf50b-2064-a084-4acf-d7c4c894e4cf/dfs/data/data2/current/BP-735959230-148.251.75.209-1676689292034] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:36,549 INFO [Listener at localhost.localdomain/34401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:36,668 INFO [Listener at localhost.localdomain/34401] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:36,687 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:36,697 INFO [Listener at localhost.localdomain/34401] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=275 (was 255) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost.localdomain/34401 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:37371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:37371 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost.localdomain:37371 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,33089,1676689292572)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:37371 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost.localdomain:37371 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:37371 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:37371 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=580 (was 657), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 284) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=2909 (was 3009) 2023-02-18 03:01:36,708 INFO [Listener at localhost.localdomain/34401] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=275, OpenFileDescriptor=580, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=165, AvailableMemoryMB=2909 2023-02-18 03:01:36,719 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/hadoop.log.dir so I do NOT create it in target/test-data/efc07f07-a519-47f7-3e44-b73381257773 2023-02-18 03:01:36,719 WARN [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/hadoop.log.dir Erasing configuration value by system value. 2023-02-18 03:01:36,719 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/hadoop.tmp.dir so I do NOT create it in target/test-data/efc07f07-a519-47f7-3e44-b73381257773 2023-02-18 03:01:36,719 WARN [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b00296ab-70ae-fb36-1224-57803e342405/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-18 03:01:36,720 DEBUG [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773 2023-02-18 03:01:36,720 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-18 03:01:36,720 INFO [Listener at localhost.localdomain/34401] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4, deleteOnExit=true 2023-02-18 03:01:36,720 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-18 03:01:36,720 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/test.cache.data in system properties and HBase conf 2023-02-18 03:01:36,720 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/hadoop.tmp.dir in system properties and HBase conf 2023-02-18 03:01:36,721 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/hadoop.log.dir in system properties and HBase conf 2023-02-18 03:01:36,721 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-18 03:01:36,721 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-18 03:01:36,721 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-18 03:01:36,721 DEBUG [Listener at localhost.localdomain/34401] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-18 03:01:36,721 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:36,722 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-18 03:01:36,722 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-18 03:01:36,722 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:36,722 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-18 03:01:36,722 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-18 03:01:36,722 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/nfs.dump.dir in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/java.io.tmpdir in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-18 03:01:36,723 INFO [Listener at localhost.localdomain/34401] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-18 03:01:36,749 WARN [Listener at localhost.localdomain/34401] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:36,750 WARN [Listener at localhost.localdomain/34401] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:36,781 WARN [Listener at localhost.localdomain/34401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:36,783 INFO [Listener at localhost.localdomain/34401] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:36,788 INFO [Listener at localhost.localdomain/34401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/java.io.tmpdir/Jetty_localhost_localdomain_46857_hdfs____lwrkdu/webapp 2023-02-18 03:01:36,861 INFO [Listener at localhost.localdomain/34401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:46857 2023-02-18 03:01:36,863 WARN [Listener at localhost.localdomain/34401] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-18 03:01:36,863 WARN [Listener at localhost.localdomain/34401] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-18 03:01:36,885 WARN [Listener at localhost.localdomain/40817] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:36,896 WARN [Listener at localhost.localdomain/40817] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:36,898 WARN [Listener at localhost.localdomain/40817] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:36,899 INFO [Listener at localhost.localdomain/40817] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:36,905 INFO [Listener at localhost.localdomain/40817] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/java.io.tmpdir/Jetty_localhost_43475_datanode____4qzb8a/webapp 2023-02-18 03:01:36,978 INFO [Listener at localhost.localdomain/40817] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43475 2023-02-18 03:01:36,986 WARN [Listener at localhost.localdomain/33451] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:36,998 WARN [Listener at localhost.localdomain/33451] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-18 03:01:36,999 WARN [Listener at localhost.localdomain/33451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-18 03:01:37,000 INFO [Listener at localhost.localdomain/33451] log.Slf4jLog(67): jetty-6.1.26 2023-02-18 03:01:37,003 INFO [Listener at localhost.localdomain/33451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/java.io.tmpdir/Jetty_localhost_40907_datanode____.9j347p/webapp 2023-02-18 03:01:37,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x309051303082bc51: Processing first storage report for DS-6599717f-0c5c-45a1-a799-cf6d95e04590 from datanode 6fe83c37-87be-4043-9f21-4e083bd66b06 2023-02-18 03:01:37,056 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x309051303082bc51: from storage DS-6599717f-0c5c-45a1-a799-cf6d95e04590 node DatanodeRegistration(127.0.0.1:38405, datanodeUuid=6fe83c37-87be-4043-9f21-4e083bd66b06, infoPort=35215, infoSecurePort=0, ipcPort=33451, storageInfo=lv=-57;cid=testClusterID;nsid=1976969511;c=1676689296752), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:37,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x309051303082bc51: Processing first storage report for DS-4ccd914e-7d63-4ce8-a398-165aac7be510 from datanode 6fe83c37-87be-4043-9f21-4e083bd66b06 2023-02-18 03:01:37,056 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x309051303082bc51: from storage DS-4ccd914e-7d63-4ce8-a398-165aac7be510 node DatanodeRegistration(127.0.0.1:38405, datanodeUuid=6fe83c37-87be-4043-9f21-4e083bd66b06, infoPort=35215, infoSecurePort=0, ipcPort=33451, storageInfo=lv=-57;cid=testClusterID;nsid=1976969511;c=1676689296752), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:37,083 INFO [Listener at localhost.localdomain/33451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40907 2023-02-18 03:01:37,098 WARN [Listener at localhost.localdomain/46265] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-18 03:01:37,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa25db87f94424805: Processing first storage report for DS-481a47ad-369b-473f-8ab6-662ae3872f60 from datanode f33e785b-2ed0-4b2c-8ae2-55de702beed2 2023-02-18 03:01:37,162 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa25db87f94424805: from storage DS-481a47ad-369b-473f-8ab6-662ae3872f60 node DatanodeRegistration(127.0.0.1:45499, datanodeUuid=f33e785b-2ed0-4b2c-8ae2-55de702beed2, infoPort=44281, infoSecurePort=0, ipcPort=46265, storageInfo=lv=-57;cid=testClusterID;nsid=1976969511;c=1676689296752), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:37,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa25db87f94424805: Processing first storage report for DS-4a1bfbdb-d759-4792-8a6d-4d36534ee2f2 from datanode f33e785b-2ed0-4b2c-8ae2-55de702beed2 2023-02-18 03:01:37,162 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa25db87f94424805: from storage DS-4a1bfbdb-d759-4792-8a6d-4d36534ee2f2 node DatanodeRegistration(127.0.0.1:45499, datanodeUuid=f33e785b-2ed0-4b2c-8ae2-55de702beed2, infoPort=44281, infoSecurePort=0, ipcPort=46265, storageInfo=lv=-57;cid=testClusterID;nsid=1976969511;c=1676689296752), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-18 03:01:37,206 DEBUG [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773 2023-02-18 03:01:37,210 INFO [Listener at localhost.localdomain/46265] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/zookeeper_0, clientPort=54967, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-18 03:01:37,212 INFO [Listener at localhost.localdomain/46265] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54967 2023-02-18 03:01:37,212 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,214 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,227 INFO [Listener at localhost.localdomain/46265] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63 with version=8 2023-02-18 03:01:37,227 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,228 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,229 INFO [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/hbase-staging 2023-02-18 03:01:37,230 INFO [Listener at localhost.localdomain/46265] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:37,230 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,231 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,231 INFO [Listener at localhost.localdomain/46265] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:37,231 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,231 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:37,231 INFO [Listener at localhost.localdomain/46265] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:37,231 INFO [Listener at localhost.localdomain/46265] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44645 2023-02-18 03:01:37,232 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,232 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,233 INFO [Listener at localhost.localdomain/46265] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44645 connecting to ZooKeeper ensemble=127.0.0.1:54967 2023-02-18 03:01:37,238 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:446450x0, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:37,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44645-0x101738810e80000 connected 2023-02-18 03:01:37,248 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:37,249 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:37,249 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:37,253 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44645 2023-02-18 03:01:37,253 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44645 2023-02-18 03:01:37,253 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44645 2023-02-18 03:01:37,254 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44645 2023-02-18 03:01:37,254 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44645 2023-02-18 03:01:37,254 INFO [Listener at localhost.localdomain/46265] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63, hbase.cluster.distributed=false 2023-02-18 03:01:37,267 INFO [Listener at localhost.localdomain/46265] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:37,267 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,267 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,267 INFO [Listener at localhost.localdomain/46265] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:37,267 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,268 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:37,268 INFO [Listener at localhost.localdomain/46265] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:37,268 INFO [Listener at localhost.localdomain/46265] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46505 2023-02-18 03:01:37,269 INFO [Listener at localhost.localdomain/46265] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:37,269 DEBUG [Listener at localhost.localdomain/46265] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:37,270 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,270 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,271 INFO [Listener at localhost.localdomain/46265] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46505 connecting to ZooKeeper ensemble=127.0.0.1:54967 2023-02-18 03:01:37,273 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:465050x0, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:37,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46505-0x101738810e80001 connected 2023-02-18 03:01:37,275 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:37,277 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:37,277 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:37,278 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46505 2023-02-18 03:01:37,278 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46505 2023-02-18 03:01:37,279 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46505 2023-02-18 03:01:37,279 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46505 2023-02-18 03:01:37,280 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46505 2023-02-18 03:01:37,294 INFO [Listener at localhost.localdomain/46265] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-02-18 03:01:37,294 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,294 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,295 INFO [Listener at localhost.localdomain/46265] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-18 03:01:37,295 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-18 03:01:37,295 INFO [Listener at localhost.localdomain/46265] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-18 03:01:37,295 INFO [Listener at localhost.localdomain/46265] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-18 03:01:37,299 INFO [Listener at localhost.localdomain/46265] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42601 2023-02-18 03:01:37,299 INFO [Listener at localhost.localdomain/46265] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-18 03:01:37,300 DEBUG [Listener at localhost.localdomain/46265] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:37,301 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,302 INFO [Listener at localhost.localdomain/46265] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,303 INFO [Listener at localhost.localdomain/46265] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42601 connecting to ZooKeeper ensemble=127.0.0.1:54967 2023-02-18 03:01:37,306 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:426010x0, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-18 03:01:37,306 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): regionserver:426010x0, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:37,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42601-0x101738810e80002 connected 2023-02-18 03:01:37,307 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:37,308 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-18 03:01:37,308 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42601 2023-02-18 03:01:37,308 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42601 2023-02-18 03:01:37,308 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42601 2023-02-18 03:01:37,308 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42601 2023-02-18 03:01:37,309 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42601 2023-02-18 03:01:37,310 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,314 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:37,314 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,315 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:37,315 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:37,315 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,315 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:37,318 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:37,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-18 03:01:37,319 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44645,1676689297230 from backup master directory 2023-02-18 03:01:37,319 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,319 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-18 03:01:37,319 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:37,319 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,328 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/hbase.id with ID: f7f155c6-1eb0-4ca2-aa6f-b9ea9f6d3569 2023-02-18 03:01:37,335 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-18 03:01:37,337 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,344 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0b23ed50 to 127.0.0.1:54967 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:37,348 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fa6e7b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:37,348 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:37,349 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-18 03:01:37,349 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:37,351 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store-tmp 2023-02-18 03:01:37,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:37,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:37,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:37,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:37,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:37,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:37,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:37,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:37,358 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/WALs/jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44645%2C1676689297230, suffix=, logDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/WALs/jenkins-hbase20.apache.org,44645,1676689297230, archiveDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/oldWALs, maxLogs=10 2023-02-18 03:01:37,370 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK] 2023-02-18 03:01:37,370 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK] 2023-02-18 03:01:37,371 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/WALs/jenkins-hbase20.apache.org,44645,1676689297230/jenkins-hbase20.apache.org%2C44645%2C1676689297230.1676689297359 2023-02-18 03:01:37,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK], DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK]] 2023-02-18 03:01:37,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:37,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:37,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:37,372 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:37,373 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:37,374 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-18 03:01:37,374 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-18 03:01:37,374 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,375 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:37,375 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:37,376 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-18 03:01:37,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:37,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67584087, jitterRate=0.007081374526023865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:37,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:37,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-18 03:01:37,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-18 03:01:37,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-18 03:01:37,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-18 03:01:37,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-18 03:01:37,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-18 03:01:37,381 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-18 03:01:37,381 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-18 03:01:37,382 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-18 03:01:37,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-18 03:01:37,392 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-18 03:01:37,392 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-18 03:01:37,393 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-18 03:01:37,393 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-18 03:01:37,394 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,395 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-18 03:01:37,395 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-18 03:01:37,396 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-18 03:01:37,396 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:37,396 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:37,396 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:37,397 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44645,1676689297230, sessionid=0x101738810e80000, setting cluster-up flag (Was=false) 2023-02-18 03:01:37,401 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,403 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-18 03:01:37,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,405 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-18 03:01:37,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:37,408 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.hbase-snapshot/.tmp 2023-02-18 03:01:37,410 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:37,410 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(952): ClusterId : f7f155c6-1eb0-4ca2-aa6f-b9ea9f6d3569 2023-02-18 03:01:37,410 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(952): ClusterId : f7f155c6-1eb0-4ca2-aa6f-b9ea9f6d3569 2023-02-18 03:01:37,410 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:37,411 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:37,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676689327414 2023-02-18 03:01:37,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-18 03:01:37,414 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:37,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-18 03:01:37,414 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-18 03:01:37,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-18 03:01:37,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-18 03:01:37,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-18 03:01:37,415 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:37,415 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:37,415 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-18 03:01:37,415 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-18 03:01:37,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-18 03:01:37,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,416 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:37,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-18 03:01:37,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-18 03:01:37,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-18 03:01:37,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-18 03:01:37,417 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-18 03:01:37,417 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:37,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689297418,5,FailOnTimeoutGroup] 2023-02-18 03:01:37,419 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689297419,5,FailOnTimeoutGroup] 2023-02-18 03:01:37,419 DEBUG [RS:1;jenkins-hbase20:42601] zookeeper.ReadOnlyZKClient(139): Connect 0x53c72b3b to 127.0.0.1:54967 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:37,419 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-18 03:01:37,419 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,421 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-18 03:01:37,422 DEBUG [RS:0;jenkins-hbase20:46505] zookeeper.ReadOnlyZKClient(139): Connect 0x6105a7b3 to 127.0.0.1:54967 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:37,422 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,422 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,429 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:37,429 DEBUG [RS:1;jenkins-hbase20:42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d00cf33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:37,430 DEBUG [RS:1;jenkins-hbase20:42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@593f404b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:37,431 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:37,431 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63 2023-02-18 03:01:37,432 DEBUG [RS:0;jenkins-hbase20:46505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fc255e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:37,432 DEBUG [RS:0;jenkins-hbase20:46505] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bfdccc3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:37,442 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:42601 2023-02-18 03:01:37,442 INFO [RS:1;jenkins-hbase20:42601] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:37,442 INFO [RS:1;jenkins-hbase20:42601] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:37,442 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:37,443 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:46505 2023-02-18 03:01:37,443 INFO [RS:0;jenkins-hbase20:46505] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-18 03:01:37,443 INFO [RS:0;jenkins-hbase20:46505] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-18 03:01:37,443 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1023): About to register with Master. 2023-02-18 03:01:37,443 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44645,1676689297230 with isa=jenkins-hbase20.apache.org/148.251.75.209:42601, startcode=1676689297294 2023-02-18 03:01:37,443 DEBUG [RS:1;jenkins-hbase20:42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:37,443 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,44645,1676689297230 with isa=jenkins-hbase20.apache.org/148.251.75.209:46505, startcode=1676689297266 2023-02-18 03:01:37,444 DEBUG [RS:0;jenkins-hbase20:46505] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-18 03:01:37,447 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36655, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:37,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,454 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58279, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-18 03:01:37,454 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63 2023-02-18 03:01:37,455 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40817 2023-02-18 03:01:37,455 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:37,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,455 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63 2023-02-18 03:01:37,455 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40817 2023-02-18 03:01:37,455 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-18 03:01:37,456 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:37,457 DEBUG [RS:1;jenkins-hbase20:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,457 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,46505,1676689297266] 2023-02-18 03:01:37,457 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42601,1676689297294] 2023-02-18 03:01:37,457 WARN [RS:1;jenkins-hbase20:42601] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:37,457 DEBUG [RS:0;jenkins-hbase20:46505] zookeeper.ZKUtil(162): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,457 INFO [RS:1;jenkins-hbase20:42601] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:37,457 WARN [RS:0;jenkins-hbase20:46505] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-18 03:01:37,458 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,458 INFO [RS:0;jenkins-hbase20:46505] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:37,458 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,461 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:37,464 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:37,464 DEBUG [RS:1;jenkins-hbase20:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,464 DEBUG [RS:0;jenkins-hbase20:46505] zookeeper.ZKUtil(162): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,464 DEBUG [RS:1;jenkins-hbase20:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,464 DEBUG [RS:0;jenkins-hbase20:46505] zookeeper.ZKUtil(162): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,465 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:37,465 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/info 2023-02-18 03:01:37,465 DEBUG [RS:0;jenkins-hbase20:46505] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-18 03:01:37,465 INFO [RS:1;jenkins-hbase20:42601] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:37,465 INFO [RS:0;jenkins-hbase20:46505] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-18 03:01:37,465 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:37,466 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,466 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:37,466 INFO [RS:1;jenkins-hbase20:42601] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:37,467 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:37,467 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:37,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:37,468 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/table 2023-02-18 03:01:37,469 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:37,469 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,471 INFO [RS:1;jenkins-hbase20:42601] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:37,471 INFO [RS:0;jenkins-hbase20:46505] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-18 03:01:37,471 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,471 INFO [RS:0;jenkins-hbase20:46505] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-18 03:01:37,472 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,472 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740 2023-02-18 03:01:37,472 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740 2023-02-18 03:01:37,473 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:37,473 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-18 03:01:37,476 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:37,477 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,477 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,477 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,478 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:37,479 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-18 03:01:37,479 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:37,479 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:0;jenkins-hbase20:46505] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,479 DEBUG [RS:1;jenkins-hbase20:42601] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-18 03:01:37,481 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,481 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,481 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,481 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,482 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:37,482 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,482 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,483 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63292196, jitterRate=-0.056872785091400146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:37,483 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:37,483 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:37,483 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:37,483 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:37,483 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:37,483 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:37,483 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:37,483 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:37,484 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-18 03:01:37,484 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-18 03:01:37,484 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-18 03:01:37,485 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-18 03:01:37,486 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-18 03:01:37,492 INFO [RS:0;jenkins-hbase20:46505] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:37,492 INFO [RS:1;jenkins-hbase20:42601] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-18 03:01:37,492 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46505,1676689297266-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,492 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42601,1676689297294-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,501 INFO [RS:0;jenkins-hbase20:46505] regionserver.Replication(203): jenkins-hbase20.apache.org,46505,1676689297266 started 2023-02-18 03:01:37,501 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,46505,1676689297266, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:46505, sessionid=0x101738810e80001 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46505,1676689297266' 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:37,501 INFO [RS:1;jenkins-hbase20:42601] regionserver.Replication(203): jenkins-hbase20.apache.org,42601,1676689297294 started 2023-02-18 03:01:37,501 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,42601,1676689297294, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42601, sessionid=0x101738810e80002 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:37,501 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42601,1676689297294' 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:37,501 DEBUG [RS:0;jenkins-hbase20:46505] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:37,502 DEBUG [RS:0;jenkins-hbase20:46505] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,46505,1676689297266' 2023-02-18 03:01:37,502 DEBUG [RS:0;jenkins-hbase20:46505] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:37,502 DEBUG [RS:0;jenkins-hbase20:46505] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,502 DEBUG [RS:0;jenkins-hbase20:46505] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42601,1676689297294' 2023-02-18 03:01:37,502 INFO [RS:0;jenkins-hbase20:46505] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:37,502 INFO [RS:0;jenkins-hbase20:46505] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:37,502 DEBUG [RS:1;jenkins-hbase20:42601] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-18 03:01:37,503 INFO [RS:1;jenkins-hbase20:42601] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-18 03:01:37,503 INFO [RS:1;jenkins-hbase20:42601] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-18 03:01:37,636 DEBUG [jenkins-hbase20:44645] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-18 03:01:37,636 DEBUG [jenkins-hbase20:44645] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:37,638 DEBUG [jenkins-hbase20:44645] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:37,638 DEBUG [jenkins-hbase20:44645] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:37,638 DEBUG [jenkins-hbase20:44645] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:37,638 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42601,1676689297294, state=OPENING 2023-02-18 03:01:37,639 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-18 03:01:37,640 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:37,641 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:37,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42601,1676689297294}] 2023-02-18 03:01:37,796 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:37,796 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:37,797 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43216, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:37,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-18 03:01:37,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-18 03:01:37,801 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42601%2C1676689297294.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,42601,1676689297294, archiveDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/oldWALs, maxLogs=32 2023-02-18 03:01:37,814 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK] 2023-02-18 03:01:37,814 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK] 2023-02-18 03:01:37,815 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,42601,1676689297294/jenkins-hbase20.apache.org%2C42601%2C1676689297294.meta.1676689297802.meta 2023-02-18 03:01:37,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK], DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK]] 2023-02-18 03:01:37,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:37,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-18 03:01:37,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-18 03:01:37,817 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-18 03:01:37,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-18 03:01:37,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:37,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-18 03:01:37,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-18 03:01:37,818 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-18 03:01:37,819 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/info 2023-02-18 03:01:37,819 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/info 2023-02-18 03:01:37,819 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-18 03:01:37,820 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,820 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-18 03:01:37,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:37,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/rep_barrier 2023-02-18 03:01:37,821 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-18 03:01:37,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-18 03:01:37,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/table 2023-02-18 03:01:37,822 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/table 2023-02-18 03:01:37,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-18 03:01:37,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:37,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740 2023-02-18 03:01:37,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740 2023-02-18 03:01:37,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-18 03:01:37,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-18 03:01:37,826 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58739739, jitterRate=-0.12470968067646027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-18 03:01:37,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: 2023-02-18 03:01:37,827 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676689297796 2023-02-18 03:01:37,831 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-18 03:01:37,834 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-18 03:01:37,834 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,42601,1676689297294, state=OPEN 2023-02-18 03:01:37,834 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-18 03:01:37,835 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-18 03:01:37,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-18 03:01:37,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,42601,1676689297294 in 194 msec 2023-02-18 03:01:37,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-18 03:01:37,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 352 msec 2023-02-18 03:01:37,838 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 428 msec 2023-02-18 03:01:37,838 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1676689297838, completionTime=-1 2023-02-18 03:01:37,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-18 03:01:37,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-18 03:01:37,841 DEBUG [hconnection-0x776ae87e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:37,843 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43226, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:37,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-18 03:01:37,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676689357844 2023-02-18 03:01:37,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676689417844 2023-02-18 03:01:37,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-18 03:01:37,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44645,1676689297230-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44645,1676689297230-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44645,1676689297230-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44645, period=300000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-18 03:01:37,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-18 03:01:37,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:37,851 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-18 03:01:37,853 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:37,853 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-18 03:01:37,854 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:37,855 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:37,855 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b empty. 2023-02-18 03:01:37,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:37,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-18 03:01:37,864 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:37,865 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 490b2d4a22c4a7e4b5e53695df4c1a3b, NAME => 'hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp 2023-02-18 03:01:37,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:37,871 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 490b2d4a22c4a7e4b5e53695df4c1a3b, disabling compactions & flushes 2023-02-18 03:01:37,872 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. after waiting 0 ms 2023-02-18 03:01:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:37,872 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:37,872 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 490b2d4a22c4a7e4b5e53695df4c1a3b: 2023-02-18 03:01:37,873 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:37,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689297874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689297874"}]},"ts":"1676689297874"} 2023-02-18 03:01:37,875 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:37,875 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:37,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689297875"}]},"ts":"1676689297875"} 2023-02-18 03:01:37,876 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-18 03:01:37,878 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:37,879 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:37,879 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:37,879 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:37,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=490b2d4a22c4a7e4b5e53695df4c1a3b, ASSIGN}] 2023-02-18 03:01:37,880 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=490b2d4a22c4a7e4b5e53695df4c1a3b, ASSIGN 2023-02-18 03:01:37,881 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=490b2d4a22c4a7e4b5e53695df4c1a3b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42601,1676689297294; forceNewPlan=false, retain=false 2023-02-18 03:01:38,031 INFO [jenkins-hbase20:44645] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:38,031 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=490b2d4a22c4a7e4b5e53695df4c1a3b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:38,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689298031"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689298031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689298031"}]},"ts":"1676689298031"} 2023-02-18 03:01:38,033 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 490b2d4a22c4a7e4b5e53695df4c1a3b, server=jenkins-hbase20.apache.org,42601,1676689297294}] 2023-02-18 03:01:38,189 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:38,190 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42601%2C1676689297294, suffix=, logDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,42601,1676689297294, archiveDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/oldWALs, maxLogs=32 2023-02-18 03:01:38,202 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK] 2023-02-18 03:01:38,202 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK] 2023-02-18 03:01:38,204 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,42601,1676689297294/jenkins-hbase20.apache.org%2C42601%2C1676689297294.1676689298190 2023-02-18 03:01:38,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK], DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK]] 2023-02-18 03:01:38,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 490b2d4a22c4a7e4b5e53695df4c1a3b, NAME => 'hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:38,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:38,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,206 INFO [StoreOpener-490b2d4a22c4a7e4b5e53695df4c1a3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,207 DEBUG [StoreOpener-490b2d4a22c4a7e4b5e53695df4c1a3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/info 2023-02-18 03:01:38,207 DEBUG [StoreOpener-490b2d4a22c4a7e4b5e53695df4c1a3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/info 2023-02-18 03:01:38,208 INFO [StoreOpener-490b2d4a22c4a7e4b5e53695df4c1a3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 490b2d4a22c4a7e4b5e53695df4c1a3b columnFamilyName info 2023-02-18 03:01:38,208 INFO [StoreOpener-490b2d4a22c4a7e4b5e53695df4c1a3b-1] regionserver.HStore(310): Store=490b2d4a22c4a7e4b5e53695df4c1a3b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:38,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:38,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:38,212 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 490b2d4a22c4a7e4b5e53695df4c1a3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66966702, jitterRate=-0.0021183788776397705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-18 03:01:38,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 490b2d4a22c4a7e4b5e53695df4c1a3b: 2023-02-18 03:01:38,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b., pid=6, masterSystemTime=1676689298185 2023-02-18 03:01:38,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:38,215 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:38,215 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=490b2d4a22c4a7e4b5e53695df4c1a3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:38,215 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676689298215"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689298215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689298215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689298215"}]},"ts":"1676689298215"} 2023-02-18 03:01:38,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-18 03:01:38,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 490b2d4a22c4a7e4b5e53695df4c1a3b, server=jenkins-hbase20.apache.org,42601,1676689297294 in 183 msec 2023-02-18 03:01:38,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-18 03:01:38,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=490b2d4a22c4a7e4b5e53695df4c1a3b, ASSIGN in 339 msec 2023-02-18 03:01:38,220 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:38,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689298220"}]},"ts":"1676689298220"} 2023-02-18 03:01:38,221 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-18 03:01:38,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:38,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-02-18 03:01:38,252 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-18 03:01:38,253 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:38,253 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:38,257 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-18 03:01:38,273 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:38,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 19 msec 2023-02-18 03:01:38,278 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-18 03:01:38,287 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-18 03:01:38,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-18 03:01:38,304 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-18 03:01:38,305 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-18 03:01:38,305 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 0.986sec 2023-02-18 03:01:38,306 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-18 03:01:38,306 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-18 03:01:38,306 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-18 03:01:38,306 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44645,1676689297230-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-18 03:01:38,306 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44645,1676689297230-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-18 03:01:38,310 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ReadOnlyZKClient(139): Connect 0x3a6b726d to 127.0.0.1:54967 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:38,311 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-02-18 03:01:38,316 DEBUG [Listener at localhost.localdomain/46265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63bea4f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:38,318 DEBUG [hconnection-0x33a550bc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:38,319 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43232, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:38,321 INFO [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:38,321 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-18 03:01:38,323 DEBUG [Listener at localhost.localdomain/46265] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-18 03:01:38,324 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40702, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-18 03:01:38,324 INFO [Listener at localhost.localdomain/46265] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 03:01:38,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-18 03:01:38,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2429) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2413) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-18 03:01:38,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 148.251.75.209:40702 deadline: 1676689358324, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-18 03:01:38,325 INFO [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-18 03:01:38,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-18 03:01:38,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-18 03:01:38,330 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-18 03:01:38,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-18 03:01:38,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-18 03:01:38,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:38,332 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,333 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 empty. 2023-02-18 03:01:38,333 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,333 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 03:01:38,354 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-18 03:01:38,360 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3cae784e901fc64193f92e8096120d20, NAME => 'testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp 2023-02-18 03:01:38,370 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:38,370 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3cae784e901fc64193f92e8096120d20, disabling compactions & flushes 2023-02-18 03:01:38,370 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,370 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,370 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. after waiting 0 ms 2023-02-18 03:01:38,370 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,371 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,371 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:38,372 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-18 03:01:38,373 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676689298373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689298373"}]},"ts":"1676689298373"} 2023-02-18 03:01:38,374 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-18 03:01:38,375 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-18 03:01:38,375 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689298375"}]},"ts":"1676689298375"} 2023-02-18 03:01:38,376 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-18 03:01:38,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-02-18 03:01:38,381 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-18 03:01:38,381 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-18 03:01:38,381 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-18 03:01:38,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, ASSIGN}] 2023-02-18 03:01:38,382 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, ASSIGN 2023-02-18 03:01:38,383 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,46505,1676689297266; forceNewPlan=false, retain=false 2023-02-18 03:01:38,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:38,505 INFO [RS:0;jenkins-hbase20:46505] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46505%2C1676689297266, suffix=, logDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,46505,1676689297266, archiveDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/oldWALs, maxLogs=32 2023-02-18 03:01:38,526 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK] 2023-02-18 03:01:38,526 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK] 2023-02-18 03:01:38,527 INFO [RS:0;jenkins-hbase20:46505] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/WALs/jenkins-hbase20.apache.org,46505,1676689297266/jenkins-hbase20.apache.org%2C46505%2C1676689297266.1676689298506 2023-02-18 03:01:38,527 DEBUG [RS:0;jenkins-hbase20:46505] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45499,DS-481a47ad-369b-473f-8ab6-662ae3872f60,DISK], DatanodeInfoWithStorage[127.0.0.1:38405,DS-6599717f-0c5c-45a1-a799-cf6d95e04590,DISK]] 2023-02-18 03:01:38,533 INFO [jenkins-hbase20:44645] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-18 03:01:38,534 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3cae784e901fc64193f92e8096120d20, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:38,534 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676689298534"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689298534"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689298534"}]},"ts":"1676689298534"} 2023-02-18 03:01:38,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 3cae784e901fc64193f92e8096120d20, server=jenkins-hbase20.apache.org,46505,1676689297266}] 2023-02-18 03:01:38,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:38,689 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:38,689 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-18 03:01:38,692 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-18 03:01:38,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3cae784e901fc64193f92e8096120d20, NAME => 'testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.', STARTKEY => '', ENDKEY => ''} 2023-02-18 03:01:38,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:38,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,703 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,705 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1 2023-02-18 03:01:38,705 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1 2023-02-18 03:01:38,705 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cae784e901fc64193f92e8096120d20 columnFamilyName f1 2023-02-18 03:01:38,706 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(310): Store=3cae784e901fc64193f92e8096120d20/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:38,706 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,708 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2 2023-02-18 03:01:38,708 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2 2023-02-18 03:01:38,709 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cae784e901fc64193f92e8096120d20 columnFamilyName f2 2023-02-18 03:01:38,709 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(310): Store=3cae784e901fc64193f92e8096120d20/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:38,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:38,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:38,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-18 03:01:38,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 3cae784e901fc64193f92e8096120d20; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64724712, jitterRate=-0.03552663326263428}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:38,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:38,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20., pid=12, masterSystemTime=1676689298689 2023-02-18 03:01:38,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:38,723 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=3cae784e901fc64193f92e8096120d20, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:38,723 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676689298723"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676689298723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676689298723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676689298723"}]},"ts":"1676689298723"} 2023-02-18 03:01:38,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-18 03:01:38,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 3cae784e901fc64193f92e8096120d20, server=jenkins-hbase20.apache.org,46505,1676689297266 in 190 msec 2023-02-18 03:01:38,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-18 03:01:38,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, ASSIGN in 346 msec 2023-02-18 03:01:38,730 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-18 03:01:38,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689298730"}]},"ts":"1676689298730"} 2023-02-18 03:01:38,732 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-18 03:01:38,734 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-18 03:01:38,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 407 msec 2023-02-18 03:01:38,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-18 03:01:38,939 INFO [Listener at localhost.localdomain/46265] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-18 03:01:38,939 DEBUG [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-18 03:01:38,939 INFO [Listener at localhost.localdomain/46265] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:38,941 INFO [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-18 03:01:38,941 INFO [Listener at localhost.localdomain/46265] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-18 03:01:38,941 INFO [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-18 03:01:38,942 INFO [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-18 03:01:38,956 DEBUG [hconnection-0x33a550bc-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:38,968 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50920, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:38,974 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,042 INFO [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-18 03:01:39,042 INFO [Listener at localhost.localdomain/46265] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-18 03:01:39,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:01:39,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676689299043 (current time:1676689299043). 2023-02-18 03:01:39,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-18 03:01:39,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] zookeeper.ReadOnlyZKClient(139): Connect 0x74946ada to 127.0.0.1:54967 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-18 03:01:39,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ee8e781, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-18 03:01:39,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-18 03:01:39,048 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-18 03:01:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74946ada to 127.0.0.1:54967 2023-02-18 03:01:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-18 03:01:39,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:01:39,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:01:39,052 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:01:39,052 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676689899052 2023-02-18 03:01:39,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-18 03:01:39,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-18 03:01:39,055 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:39,055 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-18 03:01:39,055 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-18 03:01:39,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:01:39,056 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-18 03:01:39,057 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:01:39,057 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676689899057 2023-02-18 03:01:39,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-18 03:01:39,069 INFO [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-18 03:01:39,069 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:39,070 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-18 03:01:39,070 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-18 03:01:39,070 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,070 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,071 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,071 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:39,071 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:39,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:39,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:39,072 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,072 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-18 03:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-18 03:01:39,073 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-18 03:01:39,073 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:39,073 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-18 03:01:39,074 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 03:01:39,074 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-18 03:01:39,074 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-18 03:01:39,074 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42601,1676689297294' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-18 03:01:39,076 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-18 03:01:39,076 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-18 03:01:39,076 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46505,1676689297266' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-18 03:01:39,078 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,078 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,078 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:39,079 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 03:01:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46505,1676689297266' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-18 03:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63e05695[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:39,080 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-18 03:01:39,080 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,081 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,081 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:39,081 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 03:01:39,081 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-18 03:01:39,081 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-18 03:01:39,081 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,42601,1676689297294' in zk 2023-02-18 03:01:39,081 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-18 03:01:39,081 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-18 03:01:39,081 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,081 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. started... 2023-02-18 03:01:39,081 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3cae784e901fc64193f92e8096120d20 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-18 03:01:39,082 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-18 03:01:39,082 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:39,082 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-18 03:01:39,098 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f1/39853d7bc3c34376ab52ae7dce844771 2023-02-18 03:01:39,115 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f2/33cea9a8bd264bdca9c597e506ca1349 2023-02-18 03:01:39,119 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f1/39853d7bc3c34376ab52ae7dce844771 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/39853d7bc3c34376ab52ae7dce844771 2023-02-18 03:01:39,123 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/39853d7bc3c34376ab52ae7dce844771, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:39,125 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f2/33cea9a8bd264bdca9c597e506ca1349 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/33cea9a8bd264bdca9c597e506ca1349 2023-02-18 03:01:39,129 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/33cea9a8bd264bdca9c597e506ca1349, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-18 03:01:39,130 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 3cae784e901fc64193f92e8096120d20 in 49ms, sequenceid=5, compaction requested=false 2023-02-18 03:01:39,130 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:39,130 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-18 03:01:39,131 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-18 03:01:39,131 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/39853d7bc3c34376ab52ae7dce844771] hfiles 2023-02-18 03:01:39,131 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/39853d7bc3c34376ab52ae7dce844771 for snapshot=testWithMapReduceSingleRegion 2023-02-18 03:01:39,131 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/33cea9a8bd264bdca9c597e506ca1349] hfiles 2023-02-18 03:01:39,131 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/33cea9a8bd264bdca9c597e506ca1349 for snapshot=testWithMapReduceSingleRegion 2023-02-18 03:01:39,144 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. completed. 2023-02-18 03:01:39,144 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,144 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-18 03:01:39,144 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-18 03:01:39,144 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,144 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-18 03:01:39,144 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase20.apache.org,46505,1676689297266' in zk 2023-02-18 03:01:39,145 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-18 03:01:39,145 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,145 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:39,145 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-18 03:01:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 03:01:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 03:01:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase20.apache.org,46505,1676689297266': 2023-02-18 03:01:39,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46505,1676689297266' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-18 03:01:39,147 INFO [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-18 03:01:39,147 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:39,148 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:39,148 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 INFO [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-18 03:01:39,148 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-18 03:01:39,148 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,148 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:39,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,149 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:39,149 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:39,149 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 03:01:39,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:39,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 03:01:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,150 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:39,150 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-18 03:01:39,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-18 03:01:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:39,153 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:39,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-18 03:01:39,153 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-18 03:01:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-18 03:01:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-18 03:01:39,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-18 03:01:39,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-18 03:01:39,155 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:39,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:39,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-18 03:01:39,156 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-18 03:01:39,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-18 03:01:39,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-18 03:01:39,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 03:01:39,180 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-18 03:01:39,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676689299052Consolidate snapshot: testWithMapReduceSingleRegion at 1676689299153 (+101 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676689299153Writing data manifest for testWithMapReduceSingleRegion at 1676689299155 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676689299161 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676689299180 (+19 ms) 2023-02-18 03:01:39,181 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-18 03:01:39,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 126 msec 2023-02-18 03:01:39,357 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-18 03:01:39,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-18 03:01:39,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-18 03:01:39,358 INFO [Listener at localhost.localdomain/46265] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-18 03:01:39,363 INFO [Listener at localhost.localdomain/46265] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-18 03:01:39,371 INFO [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-18 03:01:39,403 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46505] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//148.251.75.209 first region in multi=testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,480 INFO [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-18 03:01:39,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-18 03:01:39,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-18 03:01:39,485 INFO [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-18 03:01:39,485 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:39,485 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-18 03:01:39,485 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-18 03:01:39,486 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,486 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,486 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:39,486 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:39,486 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:39,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:39,487 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,487 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:39,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-18 03:01:39,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,488 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 03:01:39,488 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-18 03:01:39,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 03:01:39,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-18 03:01:39,488 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 03:01:39,488 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:39,488 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 03:01:39,488 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 03:01:39,488 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42601,1676689297294' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 03:01:39,488 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-18 03:01:39,489 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-18 03:01:39,489 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-18 03:01:39,489 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-18 03:01:39,489 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-18 03:01:39,489 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,489 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. started... 2023-02-18 03:01:39,489 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3cae784e901fc64193f92e8096120d20 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-18 03:01:39,489 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,490 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,490 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:39,505 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f1/a09da55c3c164acb8bb26779cbadd3d8 2023-02-18 03:01:39,525 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f2/87eedfb6bd814a7e83c6fbd227e088e0 2023-02-18 03:01:39,529 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f1/a09da55c3c164acb8bb26779cbadd3d8 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/a09da55c3c164acb8bb26779cbadd3d8 2023-02-18 03:01:39,532 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/a09da55c3c164acb8bb26779cbadd3d8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:39,533 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/.tmp/f2/87eedfb6bd814a7e83c6fbd227e088e0 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/87eedfb6bd814a7e83c6fbd227e088e0 2023-02-18 03:01:39,547 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/87eedfb6bd814a7e83c6fbd227e088e0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-18 03:01:39,548 INFO [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 3cae784e901fc64193f92e8096120d20 in 59ms, sequenceid=9, compaction requested=false 2023-02-18 03:01:39,548 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:39,548 DEBUG [rs(jenkins-hbase20.apache.org,46505,1676689297266)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,548 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-18 03:01:39,548 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-18 03:01:39,548 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,548 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-18 03:01:39,548 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,46505,1676689297266' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-18 03:01:39,549 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,549 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:39,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:39,550 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,550 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-18 03:01:39,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:39,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:39,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:39,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:39,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,46505,1676689297266' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-18 03:01:39,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67dfce31[Count = 0] remaining members to acquire global barrier 2023-02-18 03:01:39,552 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-18 03:01:39,552 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 03:01:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 03:01:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,46505,1676689297266' in zk 2023-02-18 03:01:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-18 03:01:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-18 03:01:39,553 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase20.apache.org,42601,1676689297294' in zk 2023-02-18 03:01:39,553 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,553 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-18 03:01:39,554 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,554 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 03:01:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:39,554 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:39,554 DEBUG [member: 'jenkins-hbase20.apache.org,46505,1676689297266' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 03:01:39,554 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-18 03:01:39,554 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:39,554 DEBUG [member: 'jenkins-hbase20.apache.org,42601,1676689297294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-18 03:01:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase20.apache.org,46505,1676689297266': 2023-02-18 03:01:39,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,46505,1676689297266' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-18 03:01:39,556 INFO [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-18 03:01:39,556 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-18 03:01:39,556 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-18 03:01:39,557 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-18 03:01:39,557 INFO [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-18 03:01:39,557 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,557 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:39,558 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-18 03:01:39,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:39,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:39,558 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-18 03:01:39,559 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-18 03:01:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,559 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-18 03:01:39,560 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-18 03:01:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-18 03:01:39,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:39,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:39,561 DEBUG [(jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-18 03:01:39,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,561 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-18 03:01:39,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-18 03:01:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-18 03:01:39,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-18 03:01:39,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-18 03:01:39,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-18 03:01:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-18 03:01:39,562 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-18 03:01:39,662 DEBUG [Listener at localhost.localdomain/46265] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-18 03:01:39,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-18 03:01:39,736 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/hadoop-6496824850374539363.jar 2023-02-18 03:01:39,739 INFO [Listener at localhost.localdomain/46265] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676689299043 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:39,739 DEBUG [Listener at localhost.localdomain/46265] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3/data/default/testWithMapReduce 2023-02-18 03:01:39,740 INFO [Listener at localhost.localdomain/46265] snapshot.RestoreSnapshotHelper(239): region to add: 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:39,740 INFO [Listener at localhost.localdomain/46265] snapshot.RestoreSnapshotHelper(585): clone region=3cae784e901fc64193f92e8096120d20 as 3cae784e901fc64193f92e8096120d20 in snapshot testWithMapReduceSingleRegion 2023-02-18 03:01:39,740 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3cae784e901fc64193f92e8096120d20, NAME => 'testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3 2023-02-18 03:01:39,752 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:39,752 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 39853d7bc3c34376ab52ae7dce844771 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-18 03:01:39,754 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33cea9a8bd264bdca9c597e506ca1349 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-18 03:01:39,755 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3cae784e901fc64193f92e8096120d20, disabling compactions & flushes 2023-02-18 03:01:39,756 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,756 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,756 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. after waiting 0 ms 2023-02-18 03:01:39,756 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,756 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:39,756 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:39,756 INFO [Listener at localhost.localdomain/46265] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676689299043 type: FLUSH version: 2 ttl: 0 2023-02-18 03:01:39,756 DEBUG [Listener at localhost.localdomain/46265] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3 2023-02-18 03:01:39,756 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(682): File system contents for path hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3 2023-02-18 03:01:39,756 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(699): |-data/ 2023-02-18 03:01:39,757 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(699): |----default/ 2023-02-18 03:01:39,757 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-18 03:01:39,757 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(699): |----------3cae784e901fc64193f92e8096120d20/ 2023-02-18 03:01:39,758 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-18 03:01:39,758 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(699): |-------------f1/ 2023-02-18 03:01:39,758 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(702): |----------------testWithMapReduce=3cae784e901fc64193f92e8096120d20-39853d7bc3c34376ab52ae7dce844771 2023-02-18 03:01:39,758 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(699): |-------------f2/ 2023-02-18 03:01:39,758 DEBUG [Listener at localhost.localdomain/46265] util.CommonFSUtils(702): |----------------testWithMapReduce=3cae784e901fc64193f92e8096120d20-33cea9a8bd264bdca9c597e506ca1349 2023-02-18 03:01:39,759 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,759 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,759 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,760 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,760 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,760 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,760 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,827 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/hadoop-7791531493754419282.jar 2023-02-18 03:01:39,828 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,828 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,828 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,829 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,829 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,829 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,830 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-18 03:01:39,830 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-18 03:01:39,831 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-18 03:01:39,831 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-18 03:01:39,831 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-18 03:01:39,832 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-18 03:01:39,832 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-18 03:01:39,832 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-18 03:01:39,833 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-18 03:01:39,833 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-18 03:01:39,834 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-18 03:01:39,834 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:39,834 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:39,835 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-18 03:01:39,835 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 03:01:39,908 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/hadoop-8847845067196921392.jar 2023-02-18 03:01:39,908 DEBUG [Listener at localhost.localdomain/46265] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-18 03:01:39,913 WARN [Listener at localhost.localdomain/46265] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-18 03:01:39,949 INFO [Listener at localhost.localdomain/46265] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-18 03:01:40,034 WARN [Listener at localhost.localdomain/46265] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/mapreduce.cluster.local.dir/1676689300008/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-18 03:01:40,034 WARN [Listener at localhost.localdomain/46265] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/mapreduce.cluster.local.dir/1676689300008/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-18 03:01:40,060 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-18 03:01:40,060 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-18 03:01:40,060 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-18 03:01:40,062 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:40,064 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1 2023-02-18 03:01:40,064 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cae784e901fc64193f92e8096120d20 columnFamilyName f1 2023-02-18 03:01:40,068 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/testWithMapReduce=3cae784e901fc64193f92e8096120d20-39853d7bc3c34376ab52ae7dce844771 2023-02-18 03:01:40,069 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(310): Store=3cae784e901fc64193f92e8096120d20/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:40,069 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:40,070 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2 2023-02-18 03:01:40,070 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3cae784e901fc64193f92e8096120d20 columnFamilyName f2 2023-02-18 03:01:40,073 DEBUG [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40817/user/jenkins/test-data/3515b0d0-01fa-3b44-733b-f89d7eef6f98/testWithMapReduceSingleRegion/b30bed64-4b31-43ae-9513-b2ea8838ebc3/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/testWithMapReduce=3cae784e901fc64193f92e8096120d20-33cea9a8bd264bdca9c597e506ca1349 2023-02-18 03:01:40,073 INFO [StoreOpener-3cae784e901fc64193f92e8096120d20-1] regionserver.HStore(310): Store=3cae784e901fc64193f92e8096120d20/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-18 03:01:40,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-18 03:01:40,074 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3cae784e901fc64193f92e8096120d20; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64859968, jitterRate=-0.03351116180419922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-18 03:01:40,074 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:40,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3cae784e901fc64193f92e8096120d20, disabling compactions & flushes 2023-02-18 03:01:40,135 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:40,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:40,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. after waiting 0 ms 2023-02-18 03:01:40,135 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:40,136 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:40,136 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:41,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "testWithMapReduceSingleRegion" 2023-02-18 03:01:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-18 03:01:41,071 INFO [Listener at localhost.localdomain/46265] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-18 03:01:41,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testWithMapReduce 2023-02-18 03:01:41,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,075 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689301075"}]},"ts":"1676689301075"} 2023-02-18 03:01:41,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:41,076 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-18 03:01:41,077 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-18 03:01:41,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, UNASSIGN}] 2023-02-18 03:01:41,078 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, UNASSIGN 2023-02-18 03:01:41,078 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3cae784e901fc64193f92e8096120d20, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:41,078 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676689301078"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676689301078"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676689301078"}]},"ts":"1676689301078"} 2023-02-18 03:01:41,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 3cae784e901fc64193f92e8096120d20, server=jenkins-hbase20.apache.org,46505,1676689297266}] 2023-02-18 03:01:41,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:41,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:41,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 3cae784e901fc64193f92e8096120d20, disabling compactions & flushes 2023-02-18 03:01:41,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:41,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:41,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. after waiting 0 ms 2023-02-18 03:01:41,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:41,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-18 03:01:41,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20. 2023-02-18 03:01:41,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 3cae784e901fc64193f92e8096120d20: 2023-02-18 03:01:41,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:41,237 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3cae784e901fc64193f92e8096120d20, regionState=CLOSED 2023-02-18 03:01:41,237 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676689301237"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676689301237"}]},"ts":"1676689301237"} 2023-02-18 03:01:41,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-18 03:01:41,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 3cae784e901fc64193f92e8096120d20, server=jenkins-hbase20.apache.org,46505,1676689297266 in 159 msec 2023-02-18 03:01:41,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-18 03:01:41,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3cae784e901fc64193f92e8096120d20, UNASSIGN in 162 msec 2023-02-18 03:01:41,242 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676689301242"}]},"ts":"1676689301242"} 2023-02-18 03:01:41,243 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-18 03:01:41,248 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-18 03:01:41,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 177 msec 2023-02-18 03:01:41,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-18 03:01:41,378 INFO [Listener at localhost.localdomain/46265] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-18 03:01:41,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testWithMapReduce 2023-02-18 03:01:41,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,383 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:41,387 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:41,390 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1, FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2, FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/recovered.edits] 2023-02-18 03:01:41,396 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/39853d7bc3c34376ab52ae7dce844771 to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/archive/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/39853d7bc3c34376ab52ae7dce844771 2023-02-18 03:01:41,398 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/a09da55c3c164acb8bb26779cbadd3d8 to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/archive/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f1/a09da55c3c164acb8bb26779cbadd3d8 2023-02-18 03:01:41,400 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/33cea9a8bd264bdca9c597e506ca1349 to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/archive/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/33cea9a8bd264bdca9c597e506ca1349 2023-02-18 03:01:41,401 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/87eedfb6bd814a7e83c6fbd227e088e0 to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/archive/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/f2/87eedfb6bd814a7e83c6fbd227e088e0 2023-02-18 03:01:41,403 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/recovered.edits/12.seqid to hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/archive/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20/recovered.edits/12.seqid 2023-02-18 03:01:41,404 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/.tmp/data/default/testWithMapReduce/3cae784e901fc64193f92e8096120d20 2023-02-18 03:01:41,404 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-18 03:01:41,405 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,407 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-18 03:01:41,408 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-18 03:01:41,409 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,409 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-18 03:01:41,409 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676689301409"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:41,410 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-18 03:01:41,411 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3cae784e901fc64193f92e8096120d20, NAME => 'testWithMapReduce,,1676689298327.3cae784e901fc64193f92e8096120d20.', STARTKEY => '', ENDKEY => ''}] 2023-02-18 03:01:41,411 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-18 03:01:41,411 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676689301411"}]},"ts":"9223372036854775807"} 2023-02-18 03:01:41,412 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-18 03:01:41,413 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-18 03:01:41,414 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 34 msec 2023-02-18 03:01:41,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44645] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-18 03:01:41,485 INFO [Listener at localhost.localdomain/46265] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-18 03:01:41,485 INFO [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-18 03:01:41,485 INFO [Listener at localhost.localdomain/46265] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-18 03:01:41,485 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a6b726d to 127.0.0.1:54967 2023-02-18 03:01:41,486 DEBUG [Listener at localhost.localdomain/46265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,486 DEBUG [Listener at localhost.localdomain/46265] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-18 03:01:41,486 DEBUG [Listener at localhost.localdomain/46265] util.JVMClusterUtil(257): Found active master hash=1629913657, stopped=false 2023-02-18 03:01:41,486 INFO [Listener at localhost.localdomain/46265] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:41,487 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:41,487 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:41,487 INFO [Listener at localhost.localdomain/46265] procedure2.ProcedureExecutor(629): Stopping 2023-02-18 03:01:41,487 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-18 03:01:41,489 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:41,489 DEBUG [Listener at localhost.localdomain/46265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b23ed50 to 127.0.0.1:54967 2023-02-18 03:01:41,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:41,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:41,489 DEBUG [Listener at localhost.localdomain/46265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-18 03:01:41,489 INFO [Listener at localhost.localdomain/46265] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,46505,1676689297266' ***** 2023-02-18 03:01:41,490 INFO [Listener at localhost.localdomain/46265] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:41,490 INFO [Listener at localhost.localdomain/46265] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,42601,1676689297294' ***** 2023-02-18 03:01:41,490 INFO [RS:0;jenkins-hbase20:46505] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:41,490 INFO [Listener at localhost.localdomain/46265] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-18 03:01:41,490 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:41,490 INFO [RS:0;jenkins-hbase20:46505] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:41,491 INFO [RS:0;jenkins-hbase20:46505] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:41,491 INFO [RS:1;jenkins-hbase20:42601] regionserver.HeapMemoryManager(220): Stopping 2023-02-18 03:01:41,491 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:41,492 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-18 03:01:41,492 DEBUG [RS:0;jenkins-hbase20:46505] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6105a7b3 to 127.0.0.1:54967 2023-02-18 03:01:41,492 INFO [RS:1;jenkins-hbase20:42601] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-18 03:01:41,492 DEBUG [RS:0;jenkins-hbase20:46505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,493 INFO [RS:1;jenkins-hbase20:42601] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-18 03:01:41,493 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,46505,1676689297266; all regions closed. 2023-02-18 03:01:41,493 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(3304): Received CLOSE for 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:41,493 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:41,493 DEBUG [RS:1;jenkins-hbase20:42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53c72b3b to 127.0.0.1:54967 2023-02-18 03:01:41,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 490b2d4a22c4a7e4b5e53695df4c1a3b, disabling compactions & flushes 2023-02-18 03:01:41,493 DEBUG [RS:1;jenkins-hbase20:42601] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:41,493 INFO [RS:1;jenkins-hbase20:42601] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:41,494 INFO [RS:1;jenkins-hbase20:42601] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:41,494 INFO [RS:1;jenkins-hbase20:42601] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:41,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:41,494 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-18 03:01:41,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. after waiting 0 ms 2023-02-18 03:01:41,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:41,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 490b2d4a22c4a7e4b5e53695df4c1a3b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-18 03:01:41,494 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-18 03:01:41,494 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1479): Online Regions={490b2d4a22c4a7e4b5e53695df4c1a3b=hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b., 1588230740=hbase:meta,,1.1588230740} 2023-02-18 03:01:41,494 DEBUG [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1505): Waiting on 1588230740, 490b2d4a22c4a7e4b5e53695df4c1a3b 2023-02-18 03:01:41,494 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-18 03:01:41,494 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-18 03:01:41,494 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-18 03:01:41,494 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-18 03:01:41,494 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-18 03:01:41,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.71 KB heapSize=7.12 KB 2023-02-18 03:01:41,497 DEBUG [RS:0;jenkins-hbase20:46505] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/oldWALs 2023-02-18 03:01:41,497 INFO [RS:0;jenkins-hbase20:46505] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C46505%2C1676689297266:(num 1676689298506) 2023-02-18 03:01:41,497 DEBUG [RS:0;jenkins-hbase20:46505] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,497 INFO [RS:0;jenkins-hbase20:46505] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:41,497 INFO [RS:0;jenkins-hbase20:46505] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:41,498 INFO [RS:0;jenkins-hbase20:46505] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-18 03:01:41,498 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:41,498 INFO [RS:0;jenkins-hbase20:46505] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-18 03:01:41,498 INFO [RS:0;jenkins-hbase20:46505] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-18 03:01:41,499 INFO [RS:0;jenkins-hbase20:46505] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46505 2023-02-18 03:01:41,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/.tmp/info/a05c70bd392b4695b0140606dfba2896 2023-02-18 03:01:41,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/.tmp/info/85dcce39af814a059de832db3a6991ac 2023-02-18 03:01:41,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85dcce39af814a059de832db3a6991ac 2023-02-18 03:01:41,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/.tmp/info/a05c70bd392b4695b0140606dfba2896 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/info/a05c70bd392b4695b0140606dfba2896 2023-02-18 03:01:41,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/info/a05c70bd392b4695b0140606dfba2896, entries=2, sequenceid=6, filesize=4.8 K 2023-02-18 03:01:41,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 490b2d4a22c4a7e4b5e53695df4c1a3b in 24ms, sequenceid=6, compaction requested=false 2023-02-18 03:01:41,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/.tmp/rep_barrier/cfe191f65baa42f0b1fc6042da0fa418 2023-02-18 03:01:41,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/namespace/490b2d4a22c4a7e4b5e53695df4c1a3b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-18 03:01:41,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:41,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 490b2d4a22c4a7e4b5e53695df4c1a3b: 2023-02-18 03:01:41,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676689297850.490b2d4a22c4a7e4b5e53695df4c1a3b. 2023-02-18 03:01:41,526 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfe191f65baa42f0b1fc6042da0fa418 2023-02-18 03:01:41,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/.tmp/table/31b3eae9c9204e5daff7fa9d5635e502 2023-02-18 03:01:41,535 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31b3eae9c9204e5daff7fa9d5635e502 2023-02-18 03:01:41,536 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/.tmp/info/85dcce39af814a059de832db3a6991ac as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/info/85dcce39af814a059de832db3a6991ac 2023-02-18 03:01:41,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85dcce39af814a059de832db3a6991ac 2023-02-18 03:01:41,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/info/85dcce39af814a059de832db3a6991ac, entries=12, sequenceid=21, filesize=6.2 K 2023-02-18 03:01:41,540 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/.tmp/rep_barrier/cfe191f65baa42f0b1fc6042da0fa418 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/rep_barrier/cfe191f65baa42f0b1fc6042da0fa418 2023-02-18 03:01:41,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cfe191f65baa42f0b1fc6042da0fa418 2023-02-18 03:01:41,544 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/rep_barrier/cfe191f65baa42f0b1fc6042da0fa418, entries=1, sequenceid=21, filesize=5.0 K 2023-02-18 03:01:41,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/.tmp/table/31b3eae9c9204e5daff7fa9d5635e502 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/table/31b3eae9c9204e5daff7fa9d5635e502 2023-02-18 03:01:41,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31b3eae9c9204e5daff7fa9d5635e502 2023-02-18 03:01:41,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/table/31b3eae9c9204e5daff7fa9d5635e502, entries=4, sequenceid=21, filesize=5.0 K 2023-02-18 03:01:41,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.71 KB/3794, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false 2023-02-18 03:01:41,551 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-18 03:01:41,552 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-18 03:01:41,552 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:41,552 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: 2023-02-18 03:01:41,552 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-18 03:01:41,579 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-18 03:01:41,579 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-18 03:01:41,586 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:41,586 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:41,596 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:41,596 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:41,596 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c19a7f5 rejected from java.util.concurrent.ThreadPoolExecutor@48263aae[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:41,596 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:41,596 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,46505,1676689297266 2023-02-18 03:01:41,596 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3dc44d15 rejected from java.util.concurrent.ThreadPoolExecutor@48263aae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:41,596 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:41,597 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,46505,1676689297266] 2023-02-18 03:01:41,597 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,46505,1676689297266; numProcessing=1 2023-02-18 03:01:41,598 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,46505,1676689297266 already deleted, retry=false 2023-02-18 03:01:41,598 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,46505,1676689297266 expired; onlineServers=1 2023-02-18 03:01:41,694 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,42601,1676689297294; all regions closed. 2023-02-18 03:01:41,697 DEBUG [RS:1;jenkins-hbase20:42601] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/oldWALs 2023-02-18 03:01:41,697 INFO [RS:1;jenkins-hbase20:42601] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42601%2C1676689297294.meta:.meta(num 1676689297802) 2023-02-18 03:01:41,700 DEBUG [RS:1;jenkins-hbase20:42601] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/oldWALs 2023-02-18 03:01:41,700 INFO [RS:1;jenkins-hbase20:42601] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42601%2C1676689297294:(num 1676689298190) 2023-02-18 03:01:41,700 DEBUG [RS:1;jenkins-hbase20:42601] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,700 INFO [RS:1;jenkins-hbase20:42601] regionserver.LeaseManager(133): Closed leases 2023-02-18 03:01:41,701 INFO [RS:1;jenkins-hbase20:42601] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-18 03:01:41,701 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:41,703 INFO [RS:1;jenkins-hbase20:42601] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42601 2023-02-18 03:01:41,704 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42601,1676689297294 2023-02-18 03:01:41,704 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-18 03:01:41,705 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42601,1676689297294] 2023-02-18 03:01:41,705 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42601,1676689297294; numProcessing=2 2023-02-18 03:01:41,705 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42601,1676689297294 already deleted, retry=false 2023-02-18 03:01:41,705 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42601,1676689297294 expired; onlineServers=0 2023-02-18 03:01:41,705 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,44645,1676689297230' ***** 2023-02-18 03:01:41,705 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-18 03:01:41,706 DEBUG [M:0;jenkins-hbase20:44645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65191ac5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-18 03:01:41,706 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,44645,1676689297230 2023-02-18 03:01:41,706 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,44645,1676689297230; all regions closed. 2023-02-18 03:01:41,706 DEBUG [M:0;jenkins-hbase20:44645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-18 03:01:41,706 DEBUG [M:0;jenkins-hbase20:44645] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-18 03:01:41,706 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-18 03:01:41,706 DEBUG [M:0;jenkins-hbase20:44645] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-18 03:01:41,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689297418] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676689297418,5,FailOnTimeoutGroup] 2023-02-18 03:01:41,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689297419] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676689297419,5,FailOnTimeoutGroup] 2023-02-18 03:01:41,707 INFO [M:0;jenkins-hbase20:44645] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-18 03:01:41,708 INFO [M:0;jenkins-hbase20:44645] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-18 03:01:41,708 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-18 03:01:41,708 INFO [M:0;jenkins-hbase20:44645] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-18 03:01:41,708 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-18 03:01:41,708 DEBUG [M:0;jenkins-hbase20:44645] master.HMaster(1512): Stopping service threads 2023-02-18 03:01:41,708 INFO [M:0;jenkins-hbase20:44645] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-18 03:01:41,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-18 03:01:41,709 ERROR [M:0;jenkins-hbase20:44645] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-18 03:01:41,709 INFO [M:0;jenkins-hbase20:44645] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-18 03:01:41,709 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-18 03:01:41,709 DEBUG [M:0;jenkins-hbase20:44645] zookeeper.ZKUtil(398): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-18 03:01:41,709 WARN [M:0;jenkins-hbase20:44645] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-18 03:01:41,709 INFO [M:0;jenkins-hbase20:44645] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-18 03:01:41,709 INFO [M:0;jenkins-hbase20:44645] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-18 03:01:41,710 DEBUG [M:0;jenkins-hbase20:44645] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-18 03:01:41,710 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:41,710 DEBUG [M:0;jenkins-hbase20:44645] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:41,710 DEBUG [M:0;jenkins-hbase20:44645] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-18 03:01:41,710 DEBUG [M:0;jenkins-hbase20:44645] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:41,710 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.74 KB heapSize=65.73 KB 2023-02-18 03:01:41,719 INFO [M:0;jenkins-hbase20:44645] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.74 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4e507983f0114c16b5d21f27d0fbab36 2023-02-18 03:01:41,722 DEBUG [M:0;jenkins-hbase20:44645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4e507983f0114c16b5d21f27d0fbab36 as hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4e507983f0114c16b5d21f27d0fbab36 2023-02-18 03:01:41,726 INFO [M:0;jenkins-hbase20:44645] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40817/user/jenkins/test-data/e3dff124-8e6e-2f6b-dc15-4354ac424d63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4e507983f0114c16b5d21f27d0fbab36, entries=17, sequenceid=132, filesize=8.6 K 2023-02-18 03:01:41,726 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegion(2947): Finished flush of dataSize ~54.74 KB/56052, heapSize ~65.71 KB/67288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-18 03:01:41,727 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-18 03:01:41,727 DEBUG [M:0;jenkins-hbase20:44645] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-02-18 03:01:41,729 INFO [M:0;jenkins-hbase20:44645] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-18 03:01:41,729 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-18 03:01:41,729 INFO [M:0;jenkins-hbase20:44645] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44645 2023-02-18 03:01:41,729 DEBUG [M:0;jenkins-hbase20:44645] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44645,1676689297230 already deleted, retry=false 2023-02-18 03:01:41,889 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:41,889 INFO [M:0;jenkins-hbase20:44645] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,44645,1676689297230; zookeeper connection closed. 2023-02-18 03:01:41,889 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c4b7e1c rejected from java.util.concurrent.ThreadPoolExecutor@2874ef4d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:41,890 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): master:44645-0x101738810e80000, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:41,891 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b9da8d8 rejected from java.util.concurrent.ThreadPoolExecutor@2874ef4d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:41,990 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:41,990 INFO [RS:1;jenkins-hbase20:42601] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,42601,1676689297294; zookeeper connection closed. 2023-02-18 03:01:41,990 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@600d7780 rejected from java.util.concurrent.ThreadPoolExecutor@6432ff59[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:41,990 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101738810e80002, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:41,990 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5626778f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5626778f 2023-02-18 03:01:41,991 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1be1ce68 rejected from java.util.concurrent.ThreadPoolExecutor@6432ff59[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:42,090 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:42,090 INFO [RS:0;jenkins-hbase20:46505] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,46505,1676689297266; zookeeper connection closed. 2023-02-18 03:01:42,090 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45e9dd2f rejected from java.util.concurrent.ThreadPoolExecutor@48263aae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:42,091 DEBUG [Listener at localhost.localdomain/46265-EventThread] zookeeper.ZKWatcher(600): regionserver:46505-0x101738810e80001, quorum=127.0.0.1:54967, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-18 03:01:42,091 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71c4a07] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71c4a07 2023-02-18 03:01:42,091 ERROR [Listener at localhost.localdomain/46265-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72b816d0 rejected from java.util.concurrent.ThreadPoolExecutor@48263aae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-18 03:01:42,091 INFO [Listener at localhost.localdomain/46265] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-18 03:01:42,092 WARN [Listener at localhost.localdomain/46265] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:42,100 INFO [Listener at localhost.localdomain/46265] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:42,201 WARN [BP-612108925-148.251.75.209-1676689296752 heartbeating to localhost.localdomain/127.0.0.1:40817] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:42,201 WARN [BP-612108925-148.251.75.209-1676689296752 heartbeating to localhost.localdomain/127.0.0.1:40817] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-612108925-148.251.75.209-1676689296752 (Datanode Uuid f33e785b-2ed0-4b2c-8ae2-55de702beed2) service to localhost.localdomain/127.0.0.1:40817 2023-02-18 03:01:42,202 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/dfs/data/data3/current/BP-612108925-148.251.75.209-1676689296752] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:42,203 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/dfs/data/data4/current/BP-612108925-148.251.75.209-1676689296752] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:42,204 WARN [Listener at localhost.localdomain/46265] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-18 03:01:42,245 INFO [Listener at localhost.localdomain/46265] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-18 03:01:42,346 WARN [BP-612108925-148.251.75.209-1676689296752 heartbeating to localhost.localdomain/127.0.0.1:40817] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-18 03:01:42,347 WARN [BP-612108925-148.251.75.209-1676689296752 heartbeating to localhost.localdomain/127.0.0.1:40817] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-612108925-148.251.75.209-1676689296752 (Datanode Uuid 6fe83c37-87be-4043-9f21-4e083bd66b06) service to localhost.localdomain/127.0.0.1:40817 2023-02-18 03:01:42,347 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/dfs/data/data1/current/BP-612108925-148.251.75.209-1676689296752] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:42,348 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/efc07f07-a519-47f7-3e44-b73381257773/cluster_d5dd5bd9-d241-c66f-1c4d-5a0c3ed576b4/dfs/data/data2/current/BP-612108925-148.251.75.209-1676689296752] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-18 03:01:42,356 INFO [Listener at localhost.localdomain/46265] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-18 03:01:42,471 INFO [Listener at localhost.localdomain/46265] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-18 03:01:42,500 INFO [Listener at localhost.localdomain/46265] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-18 03:01:42,514 INFO [Listener at localhost.localdomain/46265] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 275) Potentially hanging thread: Listener at localhost.localdomain/46265 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost.localdomain:40817 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:40817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost.localdomain:40817 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost.localdomain:40817 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:40817 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,44645,1676689297230)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:40817 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1911243681) connection to localhost.localdomain/127.0.0.1:40817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=595 (was 580) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=286 (was 285) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=2866 (was 2909)