2023-02-11 15:02:50,324 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-11 15:02:50,373 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=186, ProcessCount=169, AvailableMemoryMB=5232 2023-02-11 15:02:50,688 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2 2023-02-11 15:02:50,699 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:02:50,699 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3, deleteOnExit=true 2023-02-11 15:02:50,700 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:02:50,700 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/test.cache.data in system properties and HBase conf 2023-02-11 15:02:50,701 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:02:50,701 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:02:50,702 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:02:50,703 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:02:50,703 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:02:50,809 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-11 15:02:51,211 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:02:51,216 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:02:51,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:02:51,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:02:51,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:02:51,217 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:02:51,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:02:51,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:02:51,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:02:51,218 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:02:51,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:02:51,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:02:51,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:02:51,219 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:02:51,220 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:02:51,769 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:02:51,773 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:02:52,183 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-11 15:02:52,365 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-11 15:02:52,380 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:02:52,431 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:02:52,469 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/java.io.tmpdir/Jetty_localhost_37405_hdfs____93ycxr/webapp 2023-02-11 15:02:52,628 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37405 2023-02-11 15:02:52,670 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:02:52,670 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:02:53,169 WARN [Listener at localhost/44609] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:02:53,252 WARN [Listener at localhost/44609] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:02:53,275 WARN [Listener at localhost/44609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:02:53,282 INFO [Listener at localhost/44609] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:02:53,290 INFO [Listener at localhost/44609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/java.io.tmpdir/Jetty_localhost_42619_datanode____ms6l53/webapp 2023-02-11 15:02:53,475 INFO [Listener at localhost/44609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42619 2023-02-11 15:02:53,886 WARN [Listener at localhost/45749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:02:53,908 WARN [Listener at localhost/45749] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:02:53,913 WARN [Listener at localhost/45749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:02:53,915 INFO [Listener at localhost/45749] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:02:53,931 INFO [Listener at localhost/45749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/java.io.tmpdir/Jetty_localhost_35307_datanode____.amm2pt/webapp 2023-02-11 15:02:54,047 INFO [Listener at localhost/45749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35307 2023-02-11 15:02:54,068 WARN [Listener at localhost/36917] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:02:54,487 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x389382cc841f8ce9: Processing first storage report for DS-6f6b0191-c1dd-4248-b4dd-57904a168d57 from datanode e871af98-4b5f-4035-b2cc-fb1ac0e3ceb4 2023-02-11 15:02:54,489 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x389382cc841f8ce9: from storage DS-6f6b0191-c1dd-4248-b4dd-57904a168d57 node DatanodeRegistration(127.0.0.1:41315, datanodeUuid=e871af98-4b5f-4035-b2cc-fb1ac0e3ceb4, infoPort=43517, infoSecurePort=0, ipcPort=36917, storageInfo=lv=-57;cid=testClusterID;nsid=1313406059;c=1676127771880), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-11 15:02:54,489 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c5a43b154c6fd3d: Processing first storage report for DS-dfe59af9-6942-45d8-b666-c551a981f586 from datanode 494ab9df-7cdb-437b-9aa2-b113691cb7dd 2023-02-11 15:02:54,489 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c5a43b154c6fd3d: from storage DS-dfe59af9-6942-45d8-b666-c551a981f586 node DatanodeRegistration(127.0.0.1:46849, datanodeUuid=494ab9df-7cdb-437b-9aa2-b113691cb7dd, infoPort=37443, infoSecurePort=0, ipcPort=45749, storageInfo=lv=-57;cid=testClusterID;nsid=1313406059;c=1676127771880), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:02:54,490 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x389382cc841f8ce9: Processing first storage report for DS-ea1c9452-4489-4095-91af-abea479b8d45 from datanode e871af98-4b5f-4035-b2cc-fb1ac0e3ceb4 2023-02-11 15:02:54,490 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x389382cc841f8ce9: from storage DS-ea1c9452-4489-4095-91af-abea479b8d45 node DatanodeRegistration(127.0.0.1:41315, datanodeUuid=e871af98-4b5f-4035-b2cc-fb1ac0e3ceb4, infoPort=43517, infoSecurePort=0, ipcPort=36917, storageInfo=lv=-57;cid=testClusterID;nsid=1313406059;c=1676127771880), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:02:54,490 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6c5a43b154c6fd3d: Processing first storage report for DS-d5c0f0e1-a5b9-4eec-8ac6-66aee94eeb2a from datanode 494ab9df-7cdb-437b-9aa2-b113691cb7dd 2023-02-11 15:02:54,490 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6c5a43b154c6fd3d: from storage DS-d5c0f0e1-a5b9-4eec-8ac6-66aee94eeb2a node DatanodeRegistration(127.0.0.1:46849, datanodeUuid=494ab9df-7cdb-437b-9aa2-b113691cb7dd, infoPort=37443, infoSecurePort=0, ipcPort=45749, storageInfo=lv=-57;cid=testClusterID;nsid=1313406059;c=1676127771880), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:02:54,564 DEBUG [Listener at localhost/36917] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2 2023-02-11 15:02:54,675 INFO [Listener at localhost/36917] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/zookeeper_0, clientPort=57701, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:02:54,694 INFO [Listener at localhost/36917] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57701 2023-02-11 15:02:54,701 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:54,703 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:55,372 INFO [Listener at localhost/36917] util.FSUtils(479): Created version file at hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923 with version=8 2023-02-11 15:02:55,372 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:55,374 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:55,379 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/hbase-staging 2023-02-11 15:02:55,696 INFO [Listener at localhost/36917] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-11 15:02:56,188 INFO [Listener at localhost/36917] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:02:56,221 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,221 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,222 INFO [Listener at localhost/36917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:02:56,222 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,222 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:02:56,363 INFO [Listener at localhost/36917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:02:56,435 DEBUG [Listener at localhost/36917] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-11 15:02:56,527 INFO [Listener at localhost/36917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43623 2023-02-11 15:02:56,537 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:56,539 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:56,562 INFO [Listener at localhost/36917] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43623 connecting to ZooKeeper ensemble=127.0.0.1:57701 2023-02-11 15:02:56,619 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:436230x0, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:02:56,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43623-0x10043e811830000 connected 2023-02-11 15:02:56,648 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:02:56,649 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:02:56,653 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:02:56,662 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43623 2023-02-11 15:02:56,662 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43623 2023-02-11 15:02:56,663 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43623 2023-02-11 15:02:56,663 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43623 2023-02-11 15:02:56,663 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43623 2023-02-11 15:02:56,670 INFO [Listener at localhost/36917] master.HMaster(439): hbase.rootdir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923, hbase.cluster.distributed=false 2023-02-11 15:02:56,739 INFO [Listener at localhost/36917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:02:56,739 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,740 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,740 INFO [Listener at localhost/36917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:02:56,740 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,740 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:02:56,745 INFO [Listener at localhost/36917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:02:56,747 INFO [Listener at localhost/36917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36831 2023-02-11 15:02:56,750 INFO [Listener at localhost/36917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:02:56,757 DEBUG [Listener at localhost/36917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:02:56,758 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:56,760 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:56,761 INFO [Listener at localhost/36917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36831 connecting to ZooKeeper ensemble=127.0.0.1:57701 2023-02-11 15:02:56,766 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:368310x0, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:02:56,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36831-0x10043e811830001 connected 2023-02-11 15:02:56,768 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:02:56,769 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:02:56,770 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:02:56,772 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36831 2023-02-11 15:02:56,772 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36831 2023-02-11 15:02:56,772 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36831 2023-02-11 15:02:56,773 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36831 2023-02-11 15:02:56,773 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36831 2023-02-11 15:02:56,786 INFO [Listener at localhost/36917] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:02:56,786 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,786 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,787 INFO [Listener at localhost/36917] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:02:56,787 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:02:56,787 INFO [Listener at localhost/36917] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:02:56,788 INFO [Listener at localhost/36917] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:02:56,789 INFO [Listener at localhost/36917] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34899 2023-02-11 15:02:56,790 INFO [Listener at localhost/36917] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:02:56,795 DEBUG [Listener at localhost/36917] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:02:56,796 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:56,798 INFO [Listener at localhost/36917] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:56,801 INFO [Listener at localhost/36917] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34899 connecting to ZooKeeper ensemble=127.0.0.1:57701 2023-02-11 15:02:56,806 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:348990x0, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:02:56,807 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): regionserver:348990x0, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:02:56,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34899-0x10043e811830002 connected 2023-02-11 15:02:56,808 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:02:56,809 DEBUG [Listener at localhost/36917] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:02:56,810 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34899 2023-02-11 15:02:56,810 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34899 2023-02-11 15:02:56,811 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34899 2023-02-11 15:02:56,811 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34899 2023-02-11 15:02:56,812 DEBUG [Listener at localhost/36917] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34899 2023-02-11 15:02:56,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:56,829 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:02:56,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:56,849 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:02:56,849 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:02:56,849 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:02:56,850 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:56,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:02:56,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43623,1676127775535 from backup master directory 2023-02-11 15:02:56,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:02:56,857 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:56,857 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:02:56,858 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:02:56,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:56,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-11 15:02:56,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-11 15:02:56,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/hbase.id with ID: 6667f53b-3353-474a-85c3-05ecea245859 2023-02-11 15:02:57,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:02:57,028 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:57,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x62ce53fb to 127.0.0.1:57701 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:02:57,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fddf5a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:02:57,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:02:57,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:02:57,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-11 15:02:57,164 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-11 15:02:57,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 15:02:57,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-11 15:02:57,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:02:57,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store-tmp 2023-02-11 15:02:57,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:02:57,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:02:57,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:02:57,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:02:57,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:02:57,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:02:57,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:02:57,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127777237Disabling compacts and flushes for region at 1676127777238 (+1 ms)Disabling writes for close at 1676127777238Writing region close event to WAL at 1676127777239 (+1 ms)Closed at 1676127777239 2023-02-11 15:02:57,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/WALs/jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:57,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43623%2C1676127775535, suffix=, logDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/WALs/jenkins-hbase4.apache.org,43623,1676127775535, archiveDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/oldWALs, maxLogs=10 2023-02-11 15:02:57,320 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK] 2023-02-11 15:02:57,320 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK] 2023-02-11 15:02:57,328 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-11 15:02:57,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/WALs/jenkins-hbase4.apache.org,43623,1676127775535/jenkins-hbase4.apache.org%2C43623%2C1676127775535.1676127777274 2023-02-11 15:02:57,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK]] 2023-02-11 15:02:57,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:02:57,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:02:57,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:02:57,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:02:57,479 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:02:57,485 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:02:57,512 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:02:57,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:57,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:02:57,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:02:57,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:02:57,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:02:57,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66174990, jitterRate=-0.013915807008743286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:02:57,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127777448Initializing all the Stores at 1676127777450 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127777451 (+1 ms)Cleaning up temporary data from old regions at 1676127777536 (+85 ms)Cleaning up detritus from prior splits at 1676127777537 (+1 ms)Region opened successfully at 1676127777550 (+13 ms) 2023-02-11 15:02:57,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:02:57,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:02:57,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:02:57,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:02:57,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-11 15:02:57,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-11 15:02:57,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:02:57,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:02:57,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:02:57,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:02:57,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:02:57,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:02:57,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:02:57,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:02:57,693 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:57,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:02:57,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:02:57,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:02:57,713 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:02:57,714 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:02:57,713 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:02:57,714 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:57,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43623,1676127775535, sessionid=0x10043e811830000, setting cluster-up flag (Was=false) 2023-02-11 15:02:57,731 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:57,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:02:57,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:57,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:57,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:02:57,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:02:57,757 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/.tmp 2023-02-11 15:02:57,820 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(952): ClusterId : 6667f53b-3353-474a-85c3-05ecea245859 2023-02-11 15:02:57,820 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(952): ClusterId : 6667f53b-3353-474a-85c3-05ecea245859 2023-02-11 15:02:57,828 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:02:57,828 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:02:57,835 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:02:57,835 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:02:57,836 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:02:57,836 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:02:57,839 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:02:57,841 DEBUG [RS:0;jenkins-hbase4:36831] zookeeper.ReadOnlyZKClient(139): Connect 0x1bafa448 to 127.0.0.1:57701 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:02:57,841 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:02:57,843 DEBUG [RS:1;jenkins-hbase4:34899] zookeeper.ReadOnlyZKClient(139): Connect 0x1b1003fc to 127.0.0.1:57701 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:02:57,850 DEBUG [RS:0;jenkins-hbase4:36831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1568594d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:02:57,851 DEBUG [RS:1;jenkins-hbase4:34899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15d7eeee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:02:57,851 DEBUG [RS:0;jenkins-hbase4:36831] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1157cf38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:02:57,851 DEBUG [RS:1;jenkins-hbase4:34899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11e8688c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:02:57,878 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34899 2023-02-11 15:02:57,878 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36831 2023-02-11 15:02:57,886 INFO [RS:0;jenkins-hbase4:36831] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:02:57,886 INFO [RS:1;jenkins-hbase4:34899] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:02:57,887 INFO [RS:1;jenkins-hbase4:34899] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:02:57,886 INFO [RS:0;jenkins-hbase4:36831] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:02:57,887 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:02:57,887 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:02:57,891 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43623,1676127775535 with isa=jenkins-hbase4.apache.org/172.31.14.131:34899, startcode=1676127776785 2023-02-11 15:02:57,891 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43623,1676127775535 with isa=jenkins-hbase4.apache.org/172.31.14.131:36831, startcode=1676127776738 2023-02-11 15:02:57,911 DEBUG [RS:0;jenkins-hbase4:36831] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:02:57,911 DEBUG [RS:1;jenkins-hbase4:34899] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:02:57,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:57,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:02:57,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:57,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127807961 2023-02-11 15:02:57,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:02:57,969 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:02:57,969 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:02:57,976 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:02:57,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:02:57,979 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47837, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:02:57,979 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39157, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:02:57,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:02:57,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:02:57,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:02:57,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:02:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:02:57,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43623] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:02:57,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:02:57,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:02:57,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:02:58,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:02:58,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:02:58,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127778005,5,FailOnTimeoutGroup] 2023-02-11 15:02:58,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127778009,5,FailOnTimeoutGroup] 2023-02-11 15:02:58,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:58,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:02:58,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:58,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:58,028 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:02:58,029 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:02:58,030 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923 2023-02-11 15:02:58,034 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(2829): Master is not running yet 2023-02-11 15:02:58,034 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(2829): Master is not running yet 2023-02-11 15:02:58,034 WARN [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-11 15:02:58,034 WARN [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-11 15:02:58,048 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:02:58,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:02:58,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/info 2023-02-11 15:02:58,055 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:02:58,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:58,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:02:58,058 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:02:58,059 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:02:58,060 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:58,060 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:02:58,063 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/table 2023-02-11 15:02:58,063 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:02:58,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:58,066 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740 2023-02-11 15:02:58,067 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740 2023-02-11 15:02:58,071 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:02:58,073 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:02:58,076 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:02:58,078 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72017223, jitterRate=0.07314024865627289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:02:58,078 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127778049Initializing all the Stores at 1676127778050 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127778050Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127778050Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127778051 (+1 ms)Cleaning up temporary data from old regions at 1676127778069 (+18 ms)Cleaning up detritus from prior splits at 1676127778069Region opened successfully at 1676127778078 (+9 ms) 2023-02-11 15:02:58,079 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:02:58,079 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:02:58,079 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:02:58,079 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:02:58,079 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:02:58,080 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:02:58,080 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127778079Disabling compacts and flushes for region at 1676127778079Disabling writes for close at 1676127778079Writing region close event to WAL at 1676127778080 (+1 ms)Closed at 1676127778080 2023-02-11 15:02:58,085 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:02:58,086 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:02:58,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:02:58,106 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:02:58,112 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:02:58,263 WARN [jenkins-hbase4:43623] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-11 15:02:59,036 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43623,1676127775535 with isa=jenkins-hbase4.apache.org/172.31.14.131:36831, startcode=1676127776738 2023-02-11 15:02:59,036 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43623,1676127775535 with isa=jenkins-hbase4.apache.org/172.31.14.131:34899, startcode=1676127776785 2023-02-11 15:02:59,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,042 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43623] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,049 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923 2023-02-11 15:02:59,049 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923 2023-02-11 15:02:59,049 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44609 2023-02-11 15:02:59,049 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44609 2023-02-11 15:02:59,049 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:02:59,049 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:02:59,058 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:02:59,058 DEBUG [RS:0;jenkins-hbase4:36831] zookeeper.ZKUtil(162): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,058 DEBUG [RS:1;jenkins-hbase4:34899] zookeeper.ZKUtil(162): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,058 WARN [RS:0;jenkins-hbase4:36831] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:02:59,058 WARN [RS:1;jenkins-hbase4:34899] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:02:59,059 INFO [RS:0;jenkins-hbase4:36831] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:02:59,059 INFO [RS:1;jenkins-hbase4:34899] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:02:59,060 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,060 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,061 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36831,1676127776738] 2023-02-11 15:02:59,061 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34899,1676127776785] 2023-02-11 15:02:59,071 DEBUG [RS:0;jenkins-hbase4:36831] zookeeper.ZKUtil(162): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,071 DEBUG [RS:1;jenkins-hbase4:34899] zookeeper.ZKUtil(162): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,071 DEBUG [RS:1;jenkins-hbase4:34899] zookeeper.ZKUtil(162): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,071 DEBUG [RS:0;jenkins-hbase4:36831] zookeeper.ZKUtil(162): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,082 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:02:59,082 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:02:59,092 INFO [RS:0;jenkins-hbase4:36831] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:02:59,092 INFO [RS:1;jenkins-hbase4:34899] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:02:59,115 INFO [RS:1;jenkins-hbase4:34899] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:02:59,115 INFO [RS:0;jenkins-hbase4:36831] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:02:59,119 INFO [RS:0;jenkins-hbase4:36831] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:02:59,119 INFO [RS:1;jenkins-hbase4:34899] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:02:59,120 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,120 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,121 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:02:59,121 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:02:59,130 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,130 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,130 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,130 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,131 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:02:59,131 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:02:59,132 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:1;jenkins-hbase4:34899] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,132 DEBUG [RS:0;jenkins-hbase4:36831] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:02:59,133 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,134 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,134 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,134 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,134 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,134 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,151 INFO [RS:1;jenkins-hbase4:34899] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:02:59,151 INFO [RS:0;jenkins-hbase4:36831] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:02:59,155 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34899,1676127776785-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,155 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36831,1676127776738-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,177 INFO [RS:0;jenkins-hbase4:36831] regionserver.Replication(203): jenkins-hbase4.apache.org,36831,1676127776738 started 2023-02-11 15:02:59,178 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36831,1676127776738, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36831, sessionid=0x10043e811830001 2023-02-11 15:02:59,178 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:02:59,178 DEBUG [RS:0;jenkins-hbase4:36831] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,178 DEBUG [RS:0;jenkins-hbase4:36831] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36831,1676127776738' 2023-02-11 15:02:59,178 DEBUG [RS:0;jenkins-hbase4:36831] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:02:59,179 DEBUG [RS:0;jenkins-hbase4:36831] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:02:59,180 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:02:59,180 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:02:59,180 DEBUG [RS:0;jenkins-hbase4:36831] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:02:59,180 DEBUG [RS:0;jenkins-hbase4:36831] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36831,1676127776738' 2023-02-11 15:02:59,180 DEBUG [RS:0;jenkins-hbase4:36831] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:02:59,181 DEBUG [RS:0;jenkins-hbase4:36831] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:02:59,182 DEBUG [RS:0;jenkins-hbase4:36831] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:02:59,182 INFO [RS:0;jenkins-hbase4:36831] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:02:59,182 INFO [RS:0;jenkins-hbase4:36831] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:02:59,184 INFO [RS:1;jenkins-hbase4:34899] regionserver.Replication(203): jenkins-hbase4.apache.org,34899,1676127776785 started 2023-02-11 15:02:59,184 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34899,1676127776785, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34899, sessionid=0x10043e811830002 2023-02-11 15:02:59,184 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:02:59,184 DEBUG [RS:1;jenkins-hbase4:34899] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,185 DEBUG [RS:1;jenkins-hbase4:34899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34899,1676127776785' 2023-02-11 15:02:59,185 DEBUG [RS:1;jenkins-hbase4:34899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:02:59,186 DEBUG [RS:1;jenkins-hbase4:34899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:02:59,186 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:02:59,187 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:02:59,187 DEBUG [RS:1;jenkins-hbase4:34899] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,187 DEBUG [RS:1;jenkins-hbase4:34899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34899,1676127776785' 2023-02-11 15:02:59,187 DEBUG [RS:1;jenkins-hbase4:34899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:02:59,188 DEBUG [RS:1;jenkins-hbase4:34899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:02:59,188 DEBUG [RS:1;jenkins-hbase4:34899] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:02:59,188 INFO [RS:1;jenkins-hbase4:34899] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:02:59,189 INFO [RS:1;jenkins-hbase4:34899] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:02:59,265 DEBUG [jenkins-hbase4:43623] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:02:59,269 DEBUG [jenkins-hbase4:43623] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:02:59,276 DEBUG [jenkins-hbase4:43623] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:02:59,276 DEBUG [jenkins-hbase4:43623] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:02:59,276 DEBUG [jenkins-hbase4:43623] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:02:59,279 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34899,1676127776785, state=OPENING 2023-02-11 15:02:59,287 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:02:59,288 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:02:59,289 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:02:59,293 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:02:59,478 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:02:59,480 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:02:59,484 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:02:59,498 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:02:59,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:02:59,502 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34899%2C1676127776785.meta, suffix=.meta, logDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,34899,1676127776785, archiveDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/oldWALs, maxLogs=32 2023-02-11 15:02:59,524 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK] 2023-02-11 15:02:59,525 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK] 2023-02-11 15:02:59,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,34899,1676127776785/jenkins-hbase4.apache.org%2C34899%2C1676127776785.meta.1676127779506.meta 2023-02-11 15:02:59,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK]] 2023-02-11 15:02:59,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:02:59,532 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:02:59,558 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:02:59,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:02:59,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:02:59,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:02:59,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:02:59,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:02:59,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:02:59,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/info 2023-02-11 15:02:59,574 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/info 2023-02-11 15:02:59,575 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:02:59,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:59,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:02:59,578 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:02:59,578 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:02:59,579 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:02:59,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:59,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:02:59,582 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/table 2023-02-11 15:02:59,582 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/table 2023-02-11 15:02:59,582 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:02:59,583 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:02:59,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740 2023-02-11 15:02:59,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740 2023-02-11 15:02:59,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:02:59,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:02:59,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66991227, jitterRate=-0.0017529278993606567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:02:59,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127779570Writing region info on filesystem at 1676127779570Initializing all the Stores at 1676127779572 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127779572Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127779572Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127779572Cleaning up temporary data from old regions at 1676127779591 (+19 ms)Cleaning up detritus from prior splits at 1676127779592 (+1 ms)Running coprocessor post-open hooks at 1676127779598 (+6 ms)Region opened successfully at 1676127779598 2023-02-11 15:02:59,608 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127779470 2023-02-11 15:02:59,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:02:59,628 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:02:59,628 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34899,1676127776785, state=OPEN 2023-02-11 15:02:59,639 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:02:59,639 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:02:59,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:02:59,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34899,1676127776785 in 346 msec 2023-02-11 15:02:59,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:02:59,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.5510 sec 2023-02-11 15:02:59,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.8210 sec 2023-02-11 15:02:59,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127776845, completionTime=-1 2023-02-11 15:02:59,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:02:59,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:02:59,736 DEBUG [hconnection-0x33c2516d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:02:59,741 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49174, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:02:59,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:02:59,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127839765 2023-02-11 15:02:59,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127899765 2023-02-11 15:02:59,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 108 msec 2023-02-11 15:02:59,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43623,1676127775535-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43623,1676127775535-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43623,1676127775535-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43623, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:02:59,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:02:59,827 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:02:59,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:02:59,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:02:59,840 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:02:59,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:02:59,868 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:02:59,871 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7 empty. 2023-02-11 15:02:59,872 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:02:59,872 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:02:59,904 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:02:59,908 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 136c216c51fb97c22efe5284b618a2f7, NAME => 'hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:02:59,986 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:02:59,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 136c216c51fb97c22efe5284b618a2f7, disabling compactions & flushes 2023-02-11 15:02:59,987 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:02:59,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:02:59,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. after waiting 0 ms 2023-02-11 15:02:59,987 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:02:59,987 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:02:59,988 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 136c216c51fb97c22efe5284b618a2f7: Waiting for close lock at 1676127779987Disabling compacts and flushes for region at 1676127779987Disabling writes for close at 1676127779987Writing region close event to WAL at 1676127779987Closed at 1676127779987 2023-02-11 15:02:59,993 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:00,009 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127779996"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127779996"}]},"ts":"1676127779996"} 2023-02-11 15:03:00,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:00,040 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:00,045 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127780041"}]},"ts":"1676127780041"} 2023-02-11 15:03:00,050 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:00,054 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:00,056 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:00,056 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:00,056 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:00,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=136c216c51fb97c22efe5284b618a2f7, ASSIGN}] 2023-02-11 15:03:00,061 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=136c216c51fb97c22efe5284b618a2f7, ASSIGN 2023-02-11 15:03:00,064 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=136c216c51fb97c22efe5284b618a2f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36831,1676127776738; forceNewPlan=false, retain=false 2023-02-11 15:03:00,193 INFO [RS:0;jenkins-hbase4:36831] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36831%2C1676127776738, suffix=, logDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,36831,1676127776738, archiveDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/oldWALs, maxLogs=32 2023-02-11 15:03:00,193 INFO [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34899%2C1676127776785, suffix=, logDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,34899,1676127776785, archiveDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/oldWALs, maxLogs=32 2023-02-11 15:03:00,218 INFO [jenkins-hbase4:43623] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:00,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=136c216c51fb97c22efe5284b618a2f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:00,219 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127780219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127780219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127780219"}]},"ts":"1676127780219"} 2023-02-11 15:03:00,222 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK] 2023-02-11 15:03:00,223 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK] 2023-02-11 15:03:00,224 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK] 2023-02-11 15:03:00,225 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK] 2023-02-11 15:03:00,227 INFO [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,34899,1676127776785/jenkins-hbase4.apache.org%2C34899%2C1676127776785.1676127780195 2023-02-11 15:03:00,228 DEBUG [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK], DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK]] 2023-02-11 15:03:00,229 INFO [RS:0;jenkins-hbase4:36831] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,36831,1676127776738/jenkins-hbase4.apache.org%2C36831%2C1676127776738.1676127780195 2023-02-11 15:03:00,230 DEBUG [RS:0;jenkins-hbase4:36831] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41315,DS-6f6b0191-c1dd-4248-b4dd-57904a168d57,DISK], DatanodeInfoWithStorage[127.0.0.1:46849,DS-dfe59af9-6942-45d8-b666-c551a981f586,DISK]] 2023-02-11 15:03:00,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 136c216c51fb97c22efe5284b618a2f7, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:00,385 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:00,385 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:00,389 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:00,396 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:00,396 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 136c216c51fb97c22efe5284b618a2f7, NAME => 'hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:00,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,401 INFO [StoreOpener-136c216c51fb97c22efe5284b618a2f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,403 DEBUG [StoreOpener-136c216c51fb97c22efe5284b618a2f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/info 2023-02-11 15:03:00,403 DEBUG [StoreOpener-136c216c51fb97c22efe5284b618a2f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/info 2023-02-11 15:03:00,404 INFO [StoreOpener-136c216c51fb97c22efe5284b618a2f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 136c216c51fb97c22efe5284b618a2f7 columnFamilyName info 2023-02-11 15:03:00,405 INFO [StoreOpener-136c216c51fb97c22efe5284b618a2f7-1] regionserver.HStore(310): Store=136c216c51fb97c22efe5284b618a2f7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:00,406 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:00,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:00,442 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 136c216c51fb97c22efe5284b618a2f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66095348, jitterRate=-0.015102565288543701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:00,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 136c216c51fb97c22efe5284b618a2f7: Running coprocessor pre-open hook at 1676127780398Writing region info on filesystem at 1676127780398Initializing all the Stores at 1676127780400 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127780400Cleaning up temporary data from old regions at 1676127780408 (+8 ms)Cleaning up detritus from prior splits at 1676127780409 (+1 ms)Running coprocessor post-open hooks at 1676127780442 (+33 ms)Region opened successfully at 1676127780442 2023-02-11 15:03:00,444 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7., pid=6, masterSystemTime=1676127780385 2023-02-11 15:03:00,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:00,449 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:00,451 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=136c216c51fb97c22efe5284b618a2f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:00,452 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127780450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127780450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127780450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127780450"}]},"ts":"1676127780450"} 2023-02-11 15:03:00,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:00,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 136c216c51fb97c22efe5284b618a2f7, server=jenkins-hbase4.apache.org,36831,1676127776738 in 225 msec 2023-02-11 15:03:00,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:00,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=136c216c51fb97c22efe5284b618a2f7, ASSIGN in 401 msec 2023-02-11 15:03:00,465 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:00,465 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127780465"}]},"ts":"1676127780465"} 2023-02-11 15:03:00,468 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:00,473 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:00,475 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 644 msec 2023-02-11 15:03:00,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:00,566 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:00,567 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:00,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:00,597 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:00,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:00,631 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:00,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-02-11 15:03:00,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:00,655 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:00,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-02-11 15:03:00,668 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:00,671 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:00,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.813sec 2023-02-11 15:03:00,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:00,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:00,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:00,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43623,1676127775535-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:00,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43623,1676127775535-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:00,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:00,727 DEBUG [Listener at localhost/36917] zookeeper.ReadOnlyZKClient(139): Connect 0x5258bbcc to 127.0.0.1:57701 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:00,731 DEBUG [Listener at localhost/36917] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fa4f0e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:00,771 DEBUG [hconnection-0x46928a85-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:00,783 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49190, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:00,795 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:03:00,795 DEBUG [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:00,804 DEBUG [Listener at localhost/36917] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:00,807 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39016, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:00,812 INFO [Listener at localhost/36917] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 15:03:00,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 15:03:00,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:00,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:39016 deadline: 1676127840816, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 15:03:00,819 INFO [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 15:03:00,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:00,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 15:03:00,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:00,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:00,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 15:03:00,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:00,864 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 2023-02-11 15:03:00,866 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 empty. 2023-02-11 15:03:00,866 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:00,866 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:00,867 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:00,867 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:00,866 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:00,869 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:00,869 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 empty. 2023-02-11 15:03:00,870 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:00,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 2023-02-11 15:03:00,870 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:00,870 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 empty. 2023-02-11 15:03:00,870 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 empty. 2023-02-11 15:03:00,870 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 empty. 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 empty. 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b empty. 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c empty. 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:00,871 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:00,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:00,872 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 empty. 2023-02-11 15:03:00,872 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e empty. 2023-02-11 15:03:00,872 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:00,872 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:00,873 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:00,873 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:00,873 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 15:03:00,894 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:00,896 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 469d3054dd21983cfad82fb29e410366, NAME => 'testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,897 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => df2de8d6db2cb3d0386ed041bdad062c, NAME => 'testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,897 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 806043054b417df07e85f9a4c0591531, NAME => 'testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,935 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,936 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 806043054b417df07e85f9a4c0591531, disabling compactions & flushes 2023-02-11 15:03:00,936 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:00,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:00,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. after waiting 0 ms 2023-02-11 15:03:00,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:00,937 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:00,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 806043054b417df07e85f9a4c0591531: Waiting for close lock at 1676127780936Disabling compacts and flushes for region at 1676127780936Disabling writes for close at 1676127780937 (+1 ms)Writing region close event to WAL at 1676127780937Closed at 1676127780937 2023-02-11 15:03:00,937 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f6737ecdfb37bb096214e8d49d370465, NAME => 'testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 469d3054dd21983cfad82fb29e410366, disabling compactions & flushes 2023-02-11 15:03:00,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:00,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:00,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. after waiting 0 ms 2023-02-11 15:03:00,938 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:00,938 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:00,939 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 469d3054dd21983cfad82fb29e410366: Waiting for close lock at 1676127780938Disabling compacts and flushes for region at 1676127780938Disabling writes for close at 1676127780938Writing region close event to WAL at 1676127780938Closed at 1676127780938 2023-02-11 15:03:00,939 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c3f13a385e6198b8d8fd26b55fd70399, NAME => 'testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,940 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,941 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing df2de8d6db2cb3d0386ed041bdad062c, disabling compactions & flushes 2023-02-11 15:03:00,941 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:00,941 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:00,941 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. after waiting 0 ms 2023-02-11 15:03:00,941 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:00,941 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:00,941 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for df2de8d6db2cb3d0386ed041bdad062c: Waiting for close lock at 1676127780941Disabling compacts and flushes for region at 1676127780941Disabling writes for close at 1676127780941Writing region close event to WAL at 1676127780941Closed at 1676127780941 2023-02-11 15:03:00,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8e703d5836b126f747f8c19fd1af0a52, NAME => 'testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:00,981 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,982 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f6737ecdfb37bb096214e8d49d370465, disabling compactions & flushes 2023-02-11 15:03:00,982 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:00,982 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:00,982 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. after waiting 0 ms 2023-02-11 15:03:00,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:00,983 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:00,983 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f6737ecdfb37bb096214e8d49d370465: Waiting for close lock at 1676127780982Disabling compacts and flushes for region at 1676127780982Disabling writes for close at 1676127780983 (+1 ms)Writing region close event to WAL at 1676127780983Closed at 1676127780983 2023-02-11 15:03:00,983 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ff12effb8ed95b33aa54963a1f518e5b, NAME => 'testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,984 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 8e703d5836b126f747f8c19fd1af0a52, disabling compactions & flushes 2023-02-11 15:03:00,985 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:00,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:00,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. after waiting 0 ms 2023-02-11 15:03:00,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:00,985 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:00,985 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:00,986 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c3f13a385e6198b8d8fd26b55fd70399, disabling compactions & flushes 2023-02-11 15:03:00,986 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 8e703d5836b126f747f8c19fd1af0a52: Waiting for close lock at 1676127780985Disabling compacts and flushes for region at 1676127780985Disabling writes for close at 1676127780985Writing region close event to WAL at 1676127780985Closed at 1676127780985 2023-02-11 15:03:00,986 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:00,986 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:00,986 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d07bc8a765b8863b21b3930145a3dca4, NAME => 'testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:00,986 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. after waiting 0 ms 2023-02-11 15:03:00,986 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:00,987 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:00,987 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c3f13a385e6198b8d8fd26b55fd70399: Waiting for close lock at 1676127780986Disabling compacts and flushes for region at 1676127780986Disabling writes for close at 1676127780986Writing region close event to WAL at 1676127780987 (+1 ms)Closed at 1676127780987 2023-02-11 15:03:00,987 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 08e5a362688ef0542fddc405a6c467b0, NAME => 'testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:01,012 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d07bc8a765b8863b21b3930145a3dca4, disabling compactions & flushes 2023-02-11 15:03:01,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,015 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. after waiting 0 ms 2023-02-11 15:03:01,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ff12effb8ed95b33aa54963a1f518e5b, disabling compactions & flushes 2023-02-11 15:03:01,017 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. after waiting 0 ms 2023-02-11 15:03:01,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,017 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ff12effb8ed95b33aa54963a1f518e5b: Waiting for close lock at 1676127781016Disabling compacts and flushes for region at 1676127781016Disabling writes for close at 1676127781017 (+1 ms)Writing region close event to WAL at 1676127781017Closed at 1676127781017 2023-02-11 15:03:01,018 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7503a4fa390b8a04141ec816adc41c0e, NAME => 'testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp 2023-02-11 15:03:01,017 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,018 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d07bc8a765b8863b21b3930145a3dca4: Waiting for close lock at 1676127781015Disabling compacts and flushes for region at 1676127781015Disabling writes for close at 1676127781017 (+2 ms)Writing region close event to WAL at 1676127781018 (+1 ms)Closed at 1676127781018 2023-02-11 15:03:01,018 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 08e5a362688ef0542fddc405a6c467b0, disabling compactions & flushes 2023-02-11 15:03:01,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. after waiting 0 ms 2023-02-11 15:03:01,019 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,019 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 08e5a362688ef0542fddc405a6c467b0: Waiting for close lock at 1676127781019Disabling compacts and flushes for region at 1676127781019Disabling writes for close at 1676127781019Writing region close event to WAL at 1676127781019Closed at 1676127781019 2023-02-11 15:03:01,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 7503a4fa390b8a04141ec816adc41c0e, disabling compactions & flushes 2023-02-11 15:03:01,042 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,043 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. after waiting 0 ms 2023-02-11 15:03:01,043 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,043 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,043 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 7503a4fa390b8a04141ec816adc41c0e: Waiting for close lock at 1676127781042Disabling compacts and flushes for region at 1676127781042Disabling writes for close at 1676127781043 (+1 ms)Writing region close event to WAL at 1676127781043Closed at 1676127781043 2023-02-11 15:03:01,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:01,050 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,050 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676127780829.469d3054dd21983cfad82fb29e410366.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,050 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,051 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127781049"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127781049"}]},"ts":"1676127781049"} 2023-02-11 15:03:01,105 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 15:03:01,107 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:01,107 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127781107"}]},"ts":"1676127781107"} 2023-02-11 15:03:01,110 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 15:03:01,115 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:01,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:01,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:01,128 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:01,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, ASSIGN}] 2023-02-11 15:03:01,132 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, ASSIGN 2023-02-11 15:03:01,132 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, ASSIGN 2023-02-11 15:03:01,133 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, ASSIGN 2023-02-11 15:03:01,134 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, ASSIGN 2023-02-11 15:03:01,135 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36831,1676127776738; forceNewPlan=false, retain=false 2023-02-11 15:03:01,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, ASSIGN 2023-02-11 15:03:01,135 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36831,1676127776738; forceNewPlan=false, retain=false 2023-02-11 15:03:01,136 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34899,1676127776785; forceNewPlan=false, retain=false 2023-02-11 15:03:01,136 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34899,1676127776785; forceNewPlan=false, retain=false 2023-02-11 15:03:01,137 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34899,1676127776785; forceNewPlan=false, retain=false 2023-02-11 15:03:01,137 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, ASSIGN 2023-02-11 15:03:01,137 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, ASSIGN 2023-02-11 15:03:01,138 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, ASSIGN 2023-02-11 15:03:01,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, ASSIGN 2023-02-11 15:03:01,139 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, ASSIGN 2023-02-11 15:03:01,139 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36831,1676127776738; forceNewPlan=false, retain=false 2023-02-11 15:03:01,139 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36831,1676127776738; forceNewPlan=false, retain=false 2023-02-11 15:03:01,139 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36831,1676127776738; forceNewPlan=false, retain=false 2023-02-11 15:03:01,140 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34899,1676127776785; forceNewPlan=false, retain=false 2023-02-11 15:03:01,141 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34899,1676127776785; forceNewPlan=false, retain=false 2023-02-11 15:03:01,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:01,285 INFO [jenkins-hbase4:43623] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 15:03:01,289 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f6737ecdfb37bb096214e8d49d370465, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,290 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781289"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781289"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781289"}]},"ts":"1676127781289"} 2023-02-11 15:03:01,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7503a4fa390b8a04141ec816adc41c0e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,290 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=d07bc8a765b8863b21b3930145a3dca4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,290 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=469d3054dd21983cfad82fb29e410366, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,291 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127781290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781290"}]},"ts":"1676127781290"} 2023-02-11 15:03:01,291 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781290"}]},"ts":"1676127781290"} 2023-02-11 15:03:01,291 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676127780829.469d3054dd21983cfad82fb29e410366.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781290"}]},"ts":"1676127781290"} 2023-02-11 15:03:01,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c3f13a385e6198b8d8fd26b55fd70399, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,291 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781291"}]},"ts":"1676127781291"} 2023-02-11 15:03:01,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure f6737ecdfb37bb096214e8d49d370465, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:01,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure 7503a4fa390b8a04141ec816adc41c0e, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:01,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure d07bc8a765b8863b21b3930145a3dca4, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:01,303 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=ff12effb8ed95b33aa54963a1f518e5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,303 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781302"}]},"ts":"1676127781302"} 2023-02-11 15:03:01,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=13, state=RUNNABLE; OpenRegionProcedure 469d3054dd21983cfad82fb29e410366, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:01,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure c3f13a385e6198b8d8fd26b55fd70399, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:01,308 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8e703d5836b126f747f8c19fd1af0a52, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,308 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781308"}]},"ts":"1676127781308"} 2023-02-11 15:03:01,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure ff12effb8ed95b33aa54963a1f518e5b, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:01,310 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=806043054b417df07e85f9a4c0591531, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,310 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127781310"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781310"}]},"ts":"1676127781310"} 2023-02-11 15:03:01,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 8e703d5836b126f747f8c19fd1af0a52, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:01,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=11, state=RUNNABLE; OpenRegionProcedure 806043054b417df07e85f9a4c0591531, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:01,315 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=08e5a362688ef0542fddc405a6c467b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,316 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781315"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781315"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781315"}]},"ts":"1676127781315"} 2023-02-11 15:03:01,317 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=df2de8d6db2cb3d0386ed041bdad062c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,317 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127781317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127781317"}]},"ts":"1676127781317"} 2023-02-11 15:03:01,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 08e5a362688ef0542fddc405a6c467b0, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:01,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=12, state=RUNNABLE; OpenRegionProcedure df2de8d6db2cb3d0386ed041bdad062c, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:01,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:01,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f6737ecdfb37bb096214e8d49d370465, NAME => 'testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 15:03:01,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,462 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,472 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1 2023-02-11 15:03:01,473 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1 2023-02-11 15:03:01,474 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6737ecdfb37bb096214e8d49d370465 columnFamilyName f1 2023-02-11 15:03:01,475 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(310): Store=f6737ecdfb37bb096214e8d49d370465/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,475 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,477 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2 2023-02-11 15:03:01,478 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2 2023-02-11 15:03:01,479 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6737ecdfb37bb096214e8d49d370465 columnFamilyName f2 2023-02-11 15:03:01,480 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(310): Store=f6737ecdfb37bb096214e8d49d370465/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:01,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff12effb8ed95b33aa54963a1f518e5b, NAME => 'testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 15:03:01,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,487 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,489 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1 2023-02-11 15:03:01,489 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1 2023-02-11 15:03:01,489 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff12effb8ed95b33aa54963a1f518e5b columnFamilyName f1 2023-02-11 15:03:01,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:01,490 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(310): Store=ff12effb8ed95b33aa54963a1f518e5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,491 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,493 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2 2023-02-11 15:03:01,493 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2 2023-02-11 15:03:01,493 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff12effb8ed95b33aa54963a1f518e5b columnFamilyName f2 2023-02-11 15:03:01,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,494 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(310): Store=ff12effb8ed95b33aa54963a1f518e5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f6737ecdfb37bb096214e8d49d370465; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68791280, jitterRate=0.0250699520111084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f6737ecdfb37bb096214e8d49d370465: Running coprocessor pre-open hook at 1676127781460Writing region info on filesystem at 1676127781460Initializing all the Stores at 1676127781462 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781462Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781462Cleaning up temporary data from old regions at 1676127781486 (+24 ms)Cleaning up detritus from prior splits at 1676127781487 (+1 ms)Running coprocessor post-open hooks at 1676127781496 (+9 ms)Region opened successfully at 1676127781496 2023-02-11 15:03:01,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465., pid=21, masterSystemTime=1676127781450 2023-02-11 15:03:01,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:01,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:01,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f6737ecdfb37bb096214e8d49d370465, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781501"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781501"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781501"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781501"}]},"ts":"1676127781501"} 2023-02-11 15:03:01,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d07bc8a765b8863b21b3930145a3dca4, NAME => 'testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 15:03:01,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:01,509 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-11 15:03:01,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure f6737ecdfb37bb096214e8d49d370465, server=jenkins-hbase4.apache.org,36831,1676127776738 in 214 msec 2023-02-11 15:03:01,514 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1 2023-02-11 15:03:01,514 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1 2023-02-11 15:03:01,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,516 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07bc8a765b8863b21b3930145a3dca4 columnFamilyName f1 2023-02-11 15:03:01,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, ASSIGN in 384 msec 2023-02-11 15:03:01,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff12effb8ed95b33aa54963a1f518e5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75201670, jitterRate=0.12059220671653748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff12effb8ed95b33aa54963a1f518e5b: Running coprocessor pre-open hook at 1676127781485Writing region info on filesystem at 1676127781485Initializing all the Stores at 1676127781486 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781486Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781486Cleaning up temporary data from old regions at 1676127781499 (+13 ms)Cleaning up detritus from prior splits at 1676127781500 (+1 ms)Running coprocessor post-open hooks at 1676127781517 (+17 ms)Region opened successfully at 1676127781517 2023-02-11 15:03:01,517 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(310): Store=d07bc8a765b8863b21b3930145a3dca4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,517 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,520 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2 2023-02-11 15:03:01,520 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2 2023-02-11 15:03:01,520 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07bc8a765b8863b21b3930145a3dca4 columnFamilyName f2 2023-02-11 15:03:01,524 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(310): Store=d07bc8a765b8863b21b3930145a3dca4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b., pid=26, masterSystemTime=1676127781472 2023-02-11 15:03:01,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:01,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:01,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,528 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=ff12effb8ed95b33aa54963a1f518e5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 806043054b417df07e85f9a4c0591531, NAME => 'testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 15:03:01,532 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781528"}]},"ts":"1676127781528"} 2023-02-11 15:03:01,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:01,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d07bc8a765b8863b21b3930145a3dca4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69547201, jitterRate=0.03633405268192291}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d07bc8a765b8863b21b3930145a3dca4: Running coprocessor pre-open hook at 1676127781503Writing region info on filesystem at 1676127781503Initializing all the Stores at 1676127781505 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781505Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781509 (+4 ms)Cleaning up temporary data from old regions at 1676127781528 (+19 ms)Cleaning up detritus from prior splits at 1676127781529 (+1 ms)Running coprocessor post-open hooks at 1676127781539 (+10 ms)Region opened successfully at 1676127781539 2023-02-11 15:03:01,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4., pid=23, masterSystemTime=1676127781450 2023-02-11 15:03:01,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:01,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:01,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 469d3054dd21983cfad82fb29e410366, NAME => 'testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 15:03:01,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=d07bc8a765b8863b21b3930145a3dca4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,546 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781545"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781545"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781545"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781545"}]},"ts":"1676127781545"} 2023-02-11 15:03:01,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-11 15:03:01,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure ff12effb8ed95b33aa54963a1f518e5b, server=jenkins-hbase4.apache.org,34899,1676127776785 in 233 msec 2023-02-11 15:03:01,549 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, ASSIGN in 417 msec 2023-02-11 15:03:01,553 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,553 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-11 15:03:01,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure d07bc8a765b8863b21b3930145a3dca4, server=jenkins-hbase4.apache.org,36831,1676127776738 in 249 msec 2023-02-11 15:03:01,555 DEBUG [StoreOpener-806043054b417df07e85f9a4c0591531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f1 2023-02-11 15:03:01,555 DEBUG [StoreOpener-806043054b417df07e85f9a4c0591531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f1 2023-02-11 15:03:01,556 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 806043054b417df07e85f9a4c0591531 columnFamilyName f1 2023-02-11 15:03:01,556 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1 2023-02-11 15:03:01,556 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1 2023-02-11 15:03:01,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, ASSIGN in 425 msec 2023-02-11 15:03:01,557 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(310): Store=806043054b417df07e85f9a4c0591531/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,557 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,558 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469d3054dd21983cfad82fb29e410366 columnFamilyName f1 2023-02-11 15:03:01,559 DEBUG [StoreOpener-806043054b417df07e85f9a4c0591531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f2 2023-02-11 15:03:01,559 DEBUG [StoreOpener-806043054b417df07e85f9a4c0591531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f2 2023-02-11 15:03:01,560 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(310): Store=469d3054dd21983cfad82fb29e410366/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,560 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,560 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 806043054b417df07e85f9a4c0591531 columnFamilyName f2 2023-02-11 15:03:01,561 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(310): Store=806043054b417df07e85f9a4c0591531/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,563 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2 2023-02-11 15:03:01,563 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2 2023-02-11 15:03:01,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,564 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469d3054dd21983cfad82fb29e410366 columnFamilyName f2 2023-02-11 15:03:01,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,565 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(310): Store=469d3054dd21983cfad82fb29e410366/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:01,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:01,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 806043054b417df07e85f9a4c0591531; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71911509, jitterRate=0.07156498730182648}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 806043054b417df07e85f9a4c0591531: Running coprocessor pre-open hook at 1676127781533Writing region info on filesystem at 1676127781533Initializing all the Stores at 1676127781547 (+14 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781547Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781552 (+5 ms)Cleaning up temporary data from old regions at 1676127781567 (+15 ms)Cleaning up detritus from prior splits at 1676127781569 (+2 ms)Running coprocessor post-open hooks at 1676127781576 (+7 ms)Region opened successfully at 1676127781576 2023-02-11 15:03:01,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531., pid=28, masterSystemTime=1676127781472 2023-02-11 15:03:01,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:01,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:01,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 469d3054dd21983cfad82fb29e410366; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74766489, jitterRate=0.11410750448703766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 469d3054dd21983cfad82fb29e410366: Running coprocessor pre-open hook at 1676127781546Writing region info on filesystem at 1676127781546Initializing all the Stores at 1676127781548 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781548Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781552 (+4 ms)Cleaning up temporary data from old regions at 1676127781571 (+19 ms)Cleaning up detritus from prior splits at 1676127781571Running coprocessor post-open hooks at 1676127781581 (+10 ms)Region opened successfully at 1676127781581 2023-02-11 15:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08e5a362688ef0542fddc405a6c467b0, NAME => 'testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 15:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,581 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=806043054b417df07e85f9a4c0591531, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,582 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127781581"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781581"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781581"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781581"}]},"ts":"1676127781581"} 2023-02-11 15:03:01,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366., pid=24, masterSystemTime=1676127781450 2023-02-11 15:03:01,585 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:01,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:01,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c3f13a385e6198b8d8fd26b55fd70399, NAME => 'testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 15:03:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,586 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=469d3054dd21983cfad82fb29e410366, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,587 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676127780829.469d3054dd21983cfad82fb29e410366.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781586"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781586"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781586"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781586"}]},"ts":"1676127781586"} 2023-02-11 15:03:01,587 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1 2023-02-11 15:03:01,587 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1 2023-02-11 15:03:01,587 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e5a362688ef0542fddc405a6c467b0 columnFamilyName f1 2023-02-11 15:03:01,588 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(310): Store=08e5a362688ef0542fddc405a6c467b0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=11 2023-02-11 15:03:01,589 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=11, state=SUCCESS; OpenRegionProcedure 806043054b417df07e85f9a4c0591531, server=jenkins-hbase4.apache.org,34899,1676127776785 in 272 msec 2023-02-11 15:03:01,591 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,592 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2 2023-02-11 15:03:01,592 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2 2023-02-11 15:03:01,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, ASSIGN in 461 msec 2023-02-11 15:03:01,592 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e5a362688ef0542fddc405a6c467b0 columnFamilyName f2 2023-02-11 15:03:01,593 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(310): Store=08e5a362688ef0542fddc405a6c467b0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=13 2023-02-11 15:03:01,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=13, state=SUCCESS; OpenRegionProcedure 469d3054dd21983cfad82fb29e410366, server=jenkins-hbase4.apache.org,36831,1676127776738 in 287 msec 2023-02-11 15:03:01,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, ASSIGN in 468 msec 2023-02-11 15:03:01,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,601 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1 2023-02-11 15:03:01,601 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1 2023-02-11 15:03:01,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:01,602 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f13a385e6198b8d8fd26b55fd70399 columnFamilyName f1 2023-02-11 15:03:01,603 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(310): Store=c3f13a385e6198b8d8fd26b55fd70399/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,604 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08e5a362688ef0542fddc405a6c467b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63445531, jitterRate=-0.054587915539741516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08e5a362688ef0542fddc405a6c467b0: Running coprocessor pre-open hook at 1676127781581Writing region info on filesystem at 1676127781581Initializing all the Stores at 1676127781584 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781584Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781584Cleaning up temporary data from old regions at 1676127781598 (+14 ms)Cleaning up detritus from prior splits at 1676127781598Running coprocessor post-open hooks at 1676127781606 (+8 ms)Region opened successfully at 1676127781606 2023-02-11 15:03:01,606 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2 2023-02-11 15:03:01,606 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2 2023-02-11 15:03:01,607 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f13a385e6198b8d8fd26b55fd70399 columnFamilyName f2 2023-02-11 15:03:01,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0., pid=29, masterSystemTime=1676127781472 2023-02-11 15:03:01,607 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(310): Store=c3f13a385e6198b8d8fd26b55fd70399/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:01,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:01,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => df2de8d6db2cb3d0386ed041bdad062c, NAME => 'testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 15:03:01,612 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=08e5a362688ef0542fddc405a6c467b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,613 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781612"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781612"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781612"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781612"}]},"ts":"1676127781612"} 2023-02-11 15:03:01,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,615 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:01,617 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1 2023-02-11 15:03:01,617 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1 2023-02-11 15:03:01,618 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df2de8d6db2cb3d0386ed041bdad062c columnFamilyName f1 2023-02-11 15:03:01,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-11 15:03:01,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 08e5a362688ef0542fddc405a6c467b0, server=jenkins-hbase4.apache.org,34899,1676127776785 in 296 msec 2023-02-11 15:03:01,620 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(310): Store=df2de8d6db2cb3d0386ed041bdad062c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,621 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, ASSIGN in 491 msec 2023-02-11 15:03:01,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c3f13a385e6198b8d8fd26b55fd70399; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61793949, jitterRate=-0.07919840514659882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c3f13a385e6198b8d8fd26b55fd70399: Running coprocessor pre-open hook at 1676127781587Writing region info on filesystem at 1676127781587Initializing all the Stores at 1676127781588 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781588Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781588Cleaning up temporary data from old regions at 1676127781612 (+24 ms)Cleaning up detritus from prior splits at 1676127781612Running coprocessor post-open hooks at 1676127781622 (+10 ms)Region opened successfully at 1676127781622 2023-02-11 15:03:01,624 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2 2023-02-11 15:03:01,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399., pid=25, masterSystemTime=1676127781450 2023-02-11 15:03:01,624 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2 2023-02-11 15:03:01,625 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df2de8d6db2cb3d0386ed041bdad062c columnFamilyName f2 2023-02-11 15:03:01,626 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(310): Store=df2de8d6db2cb3d0386ed041bdad062c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:01,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:01,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7503a4fa390b8a04141ec816adc41c0e, NAME => 'testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 15:03:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,629 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c3f13a385e6198b8d8fd26b55fd70399, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,629 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781628"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781628"}]},"ts":"1676127781628"} 2023-02-11 15:03:01,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,632 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,635 DEBUG [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f1 2023-02-11 15:03:01,635 DEBUG [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f1 2023-02-11 15:03:01,636 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7503a4fa390b8a04141ec816adc41c0e columnFamilyName f1 2023-02-11 15:03:01,637 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(310): Store=7503a4fa390b8a04141ec816adc41c0e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,637 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-11 15:03:01,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure c3f13a385e6198b8d8fd26b55fd70399, server=jenkins-hbase4.apache.org,36831,1676127776738 in 325 msec 2023-02-11 15:03:01,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:01,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, ASSIGN in 508 msec 2023-02-11 15:03:01,641 DEBUG [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f2 2023-02-11 15:03:01,641 DEBUG [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f2 2023-02-11 15:03:01,641 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7503a4fa390b8a04141ec816adc41c0e columnFamilyName f2 2023-02-11 15:03:01,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,642 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(310): Store=7503a4fa390b8a04141ec816adc41c0e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened df2de8d6db2cb3d0386ed041bdad062c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59175552, jitterRate=-0.11821556091308594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for df2de8d6db2cb3d0386ed041bdad062c: Running coprocessor pre-open hook at 1676127781613Writing region info on filesystem at 1676127781613Initializing all the Stores at 1676127781614 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781614Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781615 (+1 ms)Cleaning up temporary data from old regions at 1676127781631 (+16 ms)Cleaning up detritus from prior splits at 1676127781633 (+2 ms)Running coprocessor post-open hooks at 1676127781643 (+10 ms)Region opened successfully at 1676127781643 2023-02-11 15:03:01,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c., pid=30, masterSystemTime=1676127781472 2023-02-11 15:03:01,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:01,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:01,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:01,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8e703d5836b126f747f8c19fd1af0a52, NAME => 'testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 15:03:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,648 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=df2de8d6db2cb3d0386ed041bdad062c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,648 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781648"}]},"ts":"1676127781648"} 2023-02-11 15:03:01,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:01,651 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=12 2023-02-11 15:03:01,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=12, state=SUCCESS; OpenRegionProcedure df2de8d6db2cb3d0386ed041bdad062c, server=jenkins-hbase4.apache.org,34899,1676127776785 in 330 msec 2023-02-11 15:03:01,655 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1 2023-02-11 15:03:01,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,656 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1 2023-02-11 15:03:01,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7503a4fa390b8a04141ec816adc41c0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73177898, jitterRate=0.09043565392494202}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7503a4fa390b8a04141ec816adc41c0e: Running coprocessor pre-open hook at 1676127781628Writing region info on filesystem at 1676127781628Initializing all the Stores at 1676127781631 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781631Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781631Cleaning up temporary data from old regions at 1676127781646 (+15 ms)Cleaning up detritus from prior splits at 1676127781647 (+1 ms)Running coprocessor post-open hooks at 1676127781657 (+10 ms)Region opened successfully at 1676127781657 2023-02-11 15:03:01,657 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e703d5836b126f747f8c19fd1af0a52 columnFamilyName f1 2023-02-11 15:03:01,657 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, ASSIGN in 527 msec 2023-02-11 15:03:01,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e., pid=22, masterSystemTime=1676127781450 2023-02-11 15:03:01,658 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(310): Store=8e703d5836b126f747f8c19fd1af0a52/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,658 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:01,661 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7503a4fa390b8a04141ec816adc41c0e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:01,661 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127781661"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781661"}]},"ts":"1676127781661"} 2023-02-11 15:03:01,661 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2 2023-02-11 15:03:01,661 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2 2023-02-11 15:03:01,662 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e703d5836b126f747f8c19fd1af0a52 columnFamilyName f2 2023-02-11 15:03:01,663 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(310): Store=8e703d5836b126f747f8c19fd1af0a52/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:01,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-11 15:03:01,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure 7503a4fa390b8a04141ec816adc41c0e, server=jenkins-hbase4.apache.org,36831,1676127776738 in 368 msec 2023-02-11 15:03:01,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:01,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, ASSIGN in 539 msec 2023-02-11 15:03:01,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:01,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:01,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8e703d5836b126f747f8c19fd1af0a52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70981076, jitterRate=0.05770045518875122}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:01,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8e703d5836b126f747f8c19fd1af0a52: Running coprocessor pre-open hook at 1676127781648Writing region info on filesystem at 1676127781648Initializing all the Stores at 1676127781650 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781650Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127781651 (+1 ms)Cleaning up temporary data from old regions at 1676127781668 (+17 ms)Cleaning up detritus from prior splits at 1676127781668Running coprocessor post-open hooks at 1676127781675 (+7 ms)Region opened successfully at 1676127781675 2023-02-11 15:03:01,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52., pid=27, masterSystemTime=1676127781472 2023-02-11 15:03:01,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:01,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:01,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8e703d5836b126f747f8c19fd1af0a52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:01,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127781680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127781680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127781680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127781680"}]},"ts":"1676127781680"} 2023-02-11 15:03:01,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-11 15:03:01,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 8e703d5836b126f747f8c19fd1af0a52, server=jenkins-hbase4.apache.org,34899,1676127776785 in 371 msec 2023-02-11 15:03:01,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=10 2023-02-11 15:03:01,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, ASSIGN in 557 msec 2023-02-11 15:03:01,690 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:01,691 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127781690"}]},"ts":"1676127781690"} 2023-02-11 15:03:01,693 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 15:03:01,697 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:01,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 863 msec 2023-02-11 15:03:01,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:01,987 INFO [Listener at localhost/36917] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 15:03:01,987 DEBUG [Listener at localhost/36917] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 15:03:01,989 INFO [Listener at localhost/36917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:01,998 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 15:03:01,999 INFO [Listener at localhost/36917] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:01,999 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 15:03:01,999 INFO [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:02,156 DEBUG [hconnection-0x46928a85-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:02,234 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44690, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:02,282 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36831] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:02,282 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34899] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:02,596 INFO [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:02,600 INFO [Listener at localhost/36917] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:02,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127782612 (current time:1676127782612). 2023-02-11 15:03:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] zookeeper.ReadOnlyZKClient(139): Connect 0x5d0e0949 to 127.0.0.1:57701 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:02,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10e28a85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:02,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:02,624 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49202, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:02,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d0e0949 to 127.0.0.1:57701 2023-02-11 15:03:02,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:02,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:02,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:02,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:02,651 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:02,653 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676128382653 2023-02-11 15:03:02,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:02,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 15:03:02,656 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:02,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:02,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 15 msec 2023-02-11 15:03:02,663 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:02,664 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676128382664 2023-02-11 15:03:02,666 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:02,666 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:02,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-11 15:03:02,695 INFO [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-11 15:03:02,696 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:02,696 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-11 15:03:02,696 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 15:03:02,697 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:02,697 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:02,699 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:02,699 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:02,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:02,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:02,700 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:02,701 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,701 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:02,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-11 15:03:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:02,702 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-11 15:03:02,702 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:02,702 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 15:03:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:02,702 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 15:03:02,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-11 15:03:02,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-11 15:03:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-11 15:03:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-11 15:03:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 15:03:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:02,715 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-11 15:03:02,716 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36831,1676127776738' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-11 15:03:02,716 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 15:03:02,716 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-11 15:03:02,716 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34899,1676127776785' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-11 15:03:02,719 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:02,719 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,719 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:02,720 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,721 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:02,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,722 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:02,722 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:02,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36831,1676127776738' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-11 15:03:02,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c18242e[Count = 1] remaining members to acquire global barrier 2023-02-11 15:03:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:02,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:02,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:02,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34899,1676127776785' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-11 15:03:02,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c18242e[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:02,726 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 15:03:02,726 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,728 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,728 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:02,729 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:02,729 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:02,730 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:02,730 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:02,731 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:02,737 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:02,737 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:02,737 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:02,737 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. started... 2023-02-11 15:03:02,737 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. started... 2023-02-11 15:03:02,737 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. started... 2023-02-11 15:03:02,738 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:02,738 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. started... 2023-02-11 15:03:02,738 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 15:03:02,738 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:02,740 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:02,740 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. started... 2023-02-11 15:03:02,742 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 15:03:02,742 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:02,742 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HRegion(2744): Flushing df2de8d6db2cb3d0386ed041bdad062c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 15:03:02,742 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:02,743 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. started... 2023-02-11 15:03:02,743 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8e703d5836b126f747f8c19fd1af0a52 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:02,743 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 469d3054dd21983cfad82fb29e410366 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:02,745 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c3f13a385e6198b8d8fd26b55fd70399 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:02,746 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7503a4fa390b8a04141ec816adc41c0e: 2023-02-11 15:03:02,746 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 806043054b417df07e85f9a4c0591531: 2023-02-11 15:03:02,747 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:02,747 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:02,753 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:02,753 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:02,758 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:02,760 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:02,761 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:02,762 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:02,768 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:02,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:02,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:02,789 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:02,827 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. completed. 2023-02-11 15:03:02,828 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:02,829 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:02,829 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 15:03:02,829 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. started... 2023-02-11 15:03:02,830 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f6737ecdfb37bb096214e8d49d370465 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:02,847 WARN [DataStreamer for file /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion/region-manifest.806043054b417df07e85f9a4c0591531] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-11 15:03:02,848 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. completed. 2023-02-11 15:03:02,848 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:02,852 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:02,852 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 15:03:02,852 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. started... 2023-02-11 15:03:02,853 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 08e5a362688ef0542fddc405a6c467b0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 15:03:02,982 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f1/1aee6990168c4d249a5c8f77f392fe7b 2023-02-11 15:03:02,993 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f1/4f3cfc9485d6404aa62d2b710177b48f 2023-02-11 15:03:02,993 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:02,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:02,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:02,997 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 15:03:03,029 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f1/ef2014e17c9648e28c23bea812c97056 2023-02-11 15:03:03,034 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f1/0051aefd765b42838cc9b615402d4678 2023-02-11 15:03:03,116 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f2/93c4071c8f464336ae4d42216f0a21e9 2023-02-11 15:03:03,120 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f2/15ec229bd1de4ceaa7dde1e7ac43e151 2023-02-11 15:03:03,122 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f2/8bb404f219024d5aaf0bef51cc0374fb 2023-02-11 15:03:03,131 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f1/1aee6990168c4d249a5c8f77f392fe7b as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/1aee6990168c4d249a5c8f77f392fe7b 2023-02-11 15:03:03,134 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f2/fa6cffdc56524c7ba3ea4c24e38e6e71 2023-02-11 15:03:03,140 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f1/ef2014e17c9648e28c23bea812c97056 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/ef2014e17c9648e28c23bea812c97056 2023-02-11 15:03:03,141 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f1/0051aefd765b42838cc9b615402d4678 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/0051aefd765b42838cc9b615402d4678 2023-02-11 15:03:03,149 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/1aee6990168c4d249a5c8f77f392fe7b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,151 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f1/4f3cfc9485d6404aa62d2b710177b48f as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/4f3cfc9485d6404aa62d2b710177b48f 2023-02-11 15:03:03,152 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f2/93c4071c8f464336ae4d42216f0a21e9 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/93c4071c8f464336ae4d42216f0a21e9 2023-02-11 15:03:03,153 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/ef2014e17c9648e28c23bea812c97056, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,155 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/0051aefd765b42838cc9b615402d4678, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,156 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f2/15ec229bd1de4ceaa7dde1e7ac43e151 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/15ec229bd1de4ceaa7dde1e7ac43e151 2023-02-11 15:03:03,157 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f2/8bb404f219024d5aaf0bef51cc0374fb as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/8bb404f219024d5aaf0bef51cc0374fb 2023-02-11 15:03:03,165 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/15ec229bd1de4ceaa7dde1e7ac43e151, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,167 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/4f3cfc9485d6404aa62d2b710177b48f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:03,167 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/93c4071c8f464336ae4d42216f0a21e9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,167 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f6737ecdfb37bb096214e8d49d370465 in 338ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,168 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f2/fa6cffdc56524c7ba3ea4c24e38e6e71 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/fa6cffdc56524c7ba3ea4c24e38e6e71 2023-02-11 15:03:03,168 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8e703d5836b126f747f8c19fd1af0a52 in 425ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,169 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 15:03:03,169 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 15:03:03,169 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/8bb404f219024d5aaf0bef51cc0374fb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,171 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 469d3054dd21983cfad82fb29e410366 in 428ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8e703d5836b126f747f8c19fd1af0a52: 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 469d3054dd21983cfad82fb29e410366: 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f6737ecdfb37bb096214e8d49d370465: 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/1aee6990168c4d249a5c8f77f392fe7b] hfiles 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/1aee6990168c4d249a5c8f77f392fe7b for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/0051aefd765b42838cc9b615402d4678] hfiles 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,172 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/0051aefd765b42838cc9b615402d4678 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,173 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/ef2014e17c9648e28c23bea812c97056] hfiles 2023-02-11 15:03:03,173 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/ef2014e17c9648e28c23bea812c97056 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,177 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/93c4071c8f464336ae4d42216f0a21e9] hfiles 2023-02-11 15:03:03,177 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/8bb404f219024d5aaf0bef51cc0374fb] hfiles 2023-02-11 15:03:03,177 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/15ec229bd1de4ceaa7dde1e7ac43e151] hfiles 2023-02-11 15:03:03,177 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/8bb404f219024d5aaf0bef51cc0374fb for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,177 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/93c4071c8f464336ae4d42216f0a21e9 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,177 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/15ec229bd1de4ceaa7dde1e7ac43e151 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,179 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/fa6cffdc56524c7ba3ea4c24e38e6e71, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:03,180 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for df2de8d6db2cb3d0386ed041bdad062c in 438ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,180 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for df2de8d6db2cb3d0386ed041bdad062c: 2023-02-11 15:03:03,181 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,182 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,182 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/4f3cfc9485d6404aa62d2b710177b48f] hfiles 2023-02-11 15:03:03,182 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/4f3cfc9485d6404aa62d2b710177b48f for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,182 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/fa6cffdc56524c7ba3ea4c24e38e6e71] hfiles 2023-02-11 15:03:03,182 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/fa6cffdc56524c7ba3ea4c24e38e6e71 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,196 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. completed. 2023-02-11 15:03:03,196 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:03,196 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:03,196 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 15:03:03,196 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. started... 2023-02-11 15:03:03,204 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d07bc8a765b8863b21b3930145a3dca4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:03,212 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. completed. 2023-02-11 15:03:03,212 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:03,212 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 15:03:03,215 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. completed. 2023-02-11 15:03:03,215 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:03,215 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:03,215 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 15:03:03,215 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. started... 2023-02-11 15:03:03,216 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ff12effb8ed95b33aa54963a1f518e5b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:03,222 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. completed. 2023-02-11 15:03:03,222 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:03,222 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 15:03:03,227 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f1/edc8b439e1d94f059daab7027009bf3b 2023-02-11 15:03:03,233 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f1/f1dda6636892406588d5dcd50097ba75 2023-02-11 15:03:03,257 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f2/3c9b6a6173044400a55908f905477804 2023-02-11 15:03:03,261 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f2/5fcac02cc6fd429fbd559fd9cda17fb4 2023-02-11 15:03:03,266 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f1/f1dda6636892406588d5dcd50097ba75 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/f1dda6636892406588d5dcd50097ba75 2023-02-11 15:03:03,269 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f1/edc8b439e1d94f059daab7027009bf3b as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/edc8b439e1d94f059daab7027009bf3b 2023-02-11 15:03:03,273 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/f1dda6636892406588d5dcd50097ba75, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,274 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f2/3c9b6a6173044400a55908f905477804 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/3c9b6a6173044400a55908f905477804 2023-02-11 15:03:03,277 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/edc8b439e1d94f059daab7027009bf3b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,278 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f2/5fcac02cc6fd429fbd559fd9cda17fb4 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/5fcac02cc6fd429fbd559fd9cda17fb4 2023-02-11 15:03:03,280 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/3c9b6a6173044400a55908f905477804, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,282 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ff12effb8ed95b33aa54963a1f518e5b in 66ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ff12effb8ed95b33aa54963a1f518e5b: 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/f1dda6636892406588d5dcd50097ba75] hfiles 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/f1dda6636892406588d5dcd50097ba75 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/3c9b6a6173044400a55908f905477804] hfiles 2023-02-11 15:03:03,282 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/3c9b6a6173044400a55908f905477804 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,285 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/5fcac02cc6fd429fbd559fd9cda17fb4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,287 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d07bc8a765b8863b21b3930145a3dca4 in 83ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,287 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d07bc8a765b8863b21b3930145a3dca4: 2023-02-11 15:03:03,287 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,287 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,288 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/edc8b439e1d94f059daab7027009bf3b] hfiles 2023-02-11 15:03:03,288 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/edc8b439e1d94f059daab7027009bf3b for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,288 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/5fcac02cc6fd429fbd559fd9cda17fb4] hfiles 2023-02-11 15:03:03,288 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/5fcac02cc6fd429fbd559fd9cda17fb4 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,297 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:03,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:03,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:03,299 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 15:03:03,428 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f1/b39657b5e3d545b6bc82e94062268d8a 2023-02-11 15:03:03,429 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f1/c5a69dd1340147e0a2322ae24104ec6d 2023-02-11 15:03:03,462 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f2/65ba9a2a9ea7413faf9e7a92a239c742 2023-02-11 15:03:03,467 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f2/a975b2496198407994aa9f76fa27314d 2023-02-11 15:03:03,472 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f1/b39657b5e3d545b6bc82e94062268d8a as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/b39657b5e3d545b6bc82e94062268d8a 2023-02-11 15:03:03,475 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f1/c5a69dd1340147e0a2322ae24104ec6d as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/c5a69dd1340147e0a2322ae24104ec6d 2023-02-11 15:03:03,482 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/b39657b5e3d545b6bc82e94062268d8a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:03,483 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f2/65ba9a2a9ea7413faf9e7a92a239c742 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/65ba9a2a9ea7413faf9e7a92a239c742 2023-02-11 15:03:03,484 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/c5a69dd1340147e0a2322ae24104ec6d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,486 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f2/a975b2496198407994aa9f76fa27314d as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/a975b2496198407994aa9f76fa27314d 2023-02-11 15:03:03,493 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/65ba9a2a9ea7413faf9e7a92a239c742, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:03,494 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 08e5a362688ef0542fddc405a6c467b0 in 641ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,494 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 08e5a362688ef0542fddc405a6c467b0: 2023-02-11 15:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/b39657b5e3d545b6bc82e94062268d8a] hfiles 2023-02-11 15:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/b39657b5e3d545b6bc82e94062268d8a for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/65ba9a2a9ea7413faf9e7a92a239c742] hfiles 2023-02-11 15:03:03,495 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/65ba9a2a9ea7413faf9e7a92a239c742 for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,497 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/a975b2496198407994aa9f76fa27314d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:03,498 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c3f13a385e6198b8d8fd26b55fd70399 in 754ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:03,498 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c3f13a385e6198b8d8fd26b55fd70399: 2023-02-11 15:03:03,499 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,499 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:03,499 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/c5a69dd1340147e0a2322ae24104ec6d] hfiles 2023-02-11 15:03:03,499 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/c5a69dd1340147e0a2322ae24104ec6d for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,499 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/a975b2496198407994aa9f76fa27314d] hfiles 2023-02-11 15:03:03,499 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/a975b2496198407994aa9f76fa27314d for snapshot=testWithMapReduceMultiRegion 2023-02-11 15:03:03,512 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. completed. 2023-02-11 15:03:03,512 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:03,512 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 15:03:03,519 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. completed. 2023-02-11 15:03:03,519 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:03,519 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 15:03:03,706 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. completed. 2023-02-11 15:03:03,706 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 15:03:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 15:03:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-11 15:03:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34899,1676127776785' in zk 2023-02-11 15:03:03,708 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. completed. 2023-02-11 15:03:03,708 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 15:03:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 15:03:03,708 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,709 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-11 15:03:03,709 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36831,1676127776738' in zk 2023-02-11 15:03:03,712 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,712 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-11 15:03:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:03,712 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:03,713 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-11 15:03:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-11 15:03:03,714 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:03,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:03,714 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-11 15:03:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34899,1676127776785': 2023-02-11 15:03:03,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34899,1676127776785' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 15:03:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:03,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:03,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:03,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:03,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:03,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36831,1676127776738': 2023-02-11 15:03:03,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36831,1676127776738' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:03,724 INFO [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-11 15:03:03,724 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:03,724 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:03,724 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-11 15:03:03,724 INFO [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:03,726 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,726 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:03,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:03,726 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:03,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:03,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:03,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:03,728 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,729 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,731 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,731 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:03,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-11 15:03:03,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,745 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:03,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:03,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:03,746 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:03,747 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:03,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:03,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-11 15:03:03,746 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:03,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-11 15:03:03,747 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:03,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:03,747 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-11 15:03:03,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:03,748 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-11 15:03:03,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:03,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:03,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion because node does not exist (not an error) 2023-02-11 15:03:03,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 15:03:03,799 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:03,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:03,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:03,802 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 15:03:03,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-11 15:03:03,946 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-11 15:03:03,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 15:03:03,946 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-11 15:03:03,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676127782655Consolidate snapshot: testWithMapReduceMultiRegion at 1676127783747 (+1092 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676127783747Writing data manifest for testWithMapReduceMultiRegion at 1676127783774 (+27 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676127783873 (+99 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676127783946 (+73 ms) 2023-02-11 15:03:03,948 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:03,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2910 sec 2023-02-11 15:03:04,802 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:04,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:04,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:04,805 INFO [Listener at localhost/36917] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:04,819 INFO [Listener at localhost/36917] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:04,831 INFO [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:04,893 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36831] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:04,894 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34899] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:05,013 INFO [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:05,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 15:03:05,033 INFO [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 15:03:05,033 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:05,034 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 15:03:05,034 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 15:03:05,034 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,034 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,036 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,036 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:05,036 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:05,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:05,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:05,036 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,036 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,037 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,037 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:05,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,038 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 15:03:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,038 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 15:03:05,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 15:03:05,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 15:03:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 15:03:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:05,044 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 15:03:05,045 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 15:03:05,045 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:05,045 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. started... 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7503a4fa390b8a04141ec816adc41c0e: 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. started... 2023-02-11 15:03:05,048 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 806043054b417df07e85f9a4c0591531: 2023-02-11 15:03:05,049 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. started... 2023-02-11 15:03:05,049 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:05,049 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. started... 2023-02-11 15:03:05,049 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing df2de8d6db2cb3d0386ed041bdad062c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:05,049 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c3f13a385e6198b8d8fd26b55fd70399 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:05,049 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. started... 2023-02-11 15:03:05,049 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f6737ecdfb37bb096214e8d49d370465 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. started... 2023-02-11 15:03:05,048 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. started... 2023-02-11 15:03:05,056 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8e703d5836b126f747f8c19fd1af0a52 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:05,060 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 469d3054dd21983cfad82fb29e410366 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:05,050 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 15:03:05,049 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:05,062 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. started... 2023-02-11 15:03:05,063 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 08e5a362688ef0542fddc405a6c467b0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 15:03:05,117 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-11 15:03:05,130 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f1/27be82f3a5a7448d819cc4583d35841a 2023-02-11 15:03:05,141 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f1/933863e9d0824b0588ddc54fda6156ac 2023-02-11 15:03:05,172 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f1/53be20c7e22f467cb05b06e428c40347 2023-02-11 15:03:05,183 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f1/07995829ff034b4aa2d4011d3cdbf7ea 2023-02-11 15:03:05,184 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f1/cebb80ddbfc4480aab7ae14497f7e8c7 2023-02-11 15:03:05,191 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f1/bdb9839081134623bec2ce0ebd660157 2023-02-11 15:03:05,220 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f2/5fa1eb130a584679b60936947da3714c 2023-02-11 15:03:05,235 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f2/3b2a3217d8224f0daf3ef9bf17721386 2023-02-11 15:03:05,241 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f1/27be82f3a5a7448d819cc4583d35841a as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/27be82f3a5a7448d819cc4583d35841a 2023-02-11 15:03:05,248 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f1/933863e9d0824b0588ddc54fda6156ac as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/933863e9d0824b0588ddc54fda6156ac 2023-02-11 15:03:05,250 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/27be82f3a5a7448d819cc4583d35841a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,252 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/.tmp/f2/5fa1eb130a584679b60936947da3714c as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/5fa1eb130a584679b60936947da3714c 2023-02-11 15:03:05,255 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/933863e9d0824b0588ddc54fda6156ac, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,256 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/.tmp/f2/3b2a3217d8224f0daf3ef9bf17721386 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/3b2a3217d8224f0daf3ef9bf17721386 2023-02-11 15:03:05,258 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/5fa1eb130a584679b60936947da3714c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,269 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/3b2a3217d8224f0daf3ef9bf17721386, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,269 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f6737ecdfb37bb096214e8d49d370465 in 220ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,269 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f6737ecdfb37bb096214e8d49d370465: 2023-02-11 15:03:05,269 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 15:03:05,270 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:05,270 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. started... 2023-02-11 15:03:05,270 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d07bc8a765b8863b21b3930145a3dca4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:05,270 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c3f13a385e6198b8d8fd26b55fd70399 in 221ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,270 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c3f13a385e6198b8d8fd26b55fd70399: 2023-02-11 15:03:05,270 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:05,270 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 15:03:05,272 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f2/4b9e2de671594109b6135bf80ce39ad1 2023-02-11 15:03:05,276 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f2/e37477063fb24da3bdfb4d7ded9eeff1 2023-02-11 15:03:05,278 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 15:03:05,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 15:03:05,283 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f2/ac6d70bc038e46ad9b964fbb77c6143a 2023-02-11 15:03:05,288 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f1/bdb9839081134623bec2ce0ebd660157 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/bdb9839081134623bec2ce0ebd660157 2023-02-11 15:03:05,290 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f1/cebb80ddbfc4480aab7ae14497f7e8c7 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/cebb80ddbfc4480aab7ae14497f7e8c7 2023-02-11 15:03:05,295 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f1/07995829ff034b4aa2d4011d3cdbf7ea as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/07995829ff034b4aa2d4011d3cdbf7ea 2023-02-11 15:03:05,301 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/cebb80ddbfc4480aab7ae14497f7e8c7, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:05,333 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/.tmp/f2/e37477063fb24da3bdfb4d7ded9eeff1 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/e37477063fb24da3bdfb4d7ded9eeff1 2023-02-11 15:03:05,334 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/bdb9839081134623bec2ce0ebd660157, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:05,335 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/.tmp/f2/4b9e2de671594109b6135bf80ce39ad1 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/4b9e2de671594109b6135bf80ce39ad1 2023-02-11 15:03:05,339 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/07995829ff034b4aa2d4011d3cdbf7ea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,339 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f1/2c582d4f81f644a2a8f1db7a98ece9f3 2023-02-11 15:03:05,340 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/.tmp/f2/ac6d70bc038e46ad9b964fbb77c6143a as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/ac6d70bc038e46ad9b964fbb77c6143a 2023-02-11 15:03:05,343 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/e37477063fb24da3bdfb4d7ded9eeff1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:05,345 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 08e5a362688ef0542fddc405a6c467b0 in 283ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,345 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 08e5a362688ef0542fddc405a6c467b0: 2023-02-11 15:03:05,345 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:05,345 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 15:03:05,345 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:05,345 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. started... 2023-02-11 15:03:05,345 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ff12effb8ed95b33aa54963a1f518e5b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:05,362 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/4b9e2de671594109b6135bf80ce39ad1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:05,365 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/ac6d70bc038e46ad9b964fbb77c6143a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,365 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for df2de8d6db2cb3d0386ed041bdad062c in 316ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,365 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for df2de8d6db2cb3d0386ed041bdad062c: 2023-02-11 15:03:05,365 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:05,365 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 15:03:05,366 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 469d3054dd21983cfad82fb29e410366 in 310ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,366 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 469d3054dd21983cfad82fb29e410366: 2023-02-11 15:03:05,366 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:05,366 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 15:03:05,378 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f2/f038fdc956464164ad0d0ee35b91cfce 2023-02-11 15:03:05,388 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f1/e89f3dd7105e40aca13e0eaca455fe42 2023-02-11 15:03:05,395 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f1/2c582d4f81f644a2a8f1db7a98ece9f3 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/2c582d4f81f644a2a8f1db7a98ece9f3 2023-02-11 15:03:05,402 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/2c582d4f81f644a2a8f1db7a98ece9f3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,403 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/.tmp/f2/f038fdc956464164ad0d0ee35b91cfce as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/f038fdc956464164ad0d0ee35b91cfce 2023-02-11 15:03:05,413 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/f038fdc956464164ad0d0ee35b91cfce, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,414 INFO [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d07bc8a765b8863b21b3930145a3dca4 in 144ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,414 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d07bc8a765b8863b21b3930145a3dca4: 2023-02-11 15:03:05,414 DEBUG [rs(jenkins-hbase4.apache.org,36831,1676127776738)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:05,415 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 15:03:05,415 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 15:03:05,415 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,415 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 15:03:05,415 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f2/bbd97761ef6b4fb5bf63061b41063998 2023-02-11 15:03:05,415 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36831,1676127776738' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 15:03:05,418 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,418 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:05,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:05,418 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,418 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:05,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:05,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36831,1676127776738' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 15:03:05,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79635f01[Count = 1] remaining members to acquire global barrier 2023-02-11 15:03:05,424 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f1/e89f3dd7105e40aca13e0eaca455fe42 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/e89f3dd7105e40aca13e0eaca455fe42 2023-02-11 15:03:05,429 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/e89f3dd7105e40aca13e0eaca455fe42, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,430 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/.tmp/f2/bbd97761ef6b4fb5bf63061b41063998 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/bbd97761ef6b4fb5bf63061b41063998 2023-02-11 15:03:05,437 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/bbd97761ef6b4fb5bf63061b41063998, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,439 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ff12effb8ed95b33aa54963a1f518e5b in 93ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,439 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ff12effb8ed95b33aa54963a1f518e5b: 2023-02-11 15:03:05,439 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:05,439 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 15:03:05,642 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f2/dd445a21de0548a99b0d6313b6761684 2023-02-11 15:03:05,648 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f1/53be20c7e22f467cb05b06e428c40347 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/53be20c7e22f467cb05b06e428c40347 2023-02-11 15:03:05,654 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/53be20c7e22f467cb05b06e428c40347, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,655 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/.tmp/f2/dd445a21de0548a99b0d6313b6761684 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/dd445a21de0548a99b0d6313b6761684 2023-02-11 15:03:05,660 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/dd445a21de0548a99b0d6313b6761684, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:05,661 INFO [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8e703d5836b126f747f8c19fd1af0a52 in 610ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:05,661 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8e703d5836b126f747f8c19fd1af0a52: 2023-02-11 15:03:05,662 DEBUG [rs(jenkins-hbase4.apache.org,34899,1676127776785)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 15:03:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 15:03:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 15:03:05,662 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34899,1676127776785' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 15:03:05,664 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,664 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:05,664 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,664 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:05,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34899,1676127776785' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 15:03:05,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79635f01[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:05,667 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 15:03:05,667 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,674 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,674 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 15:03:05,674 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 15:03:05,674 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36831,1676127776738' in zk 2023-02-11 15:03:05,674 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 15:03:05,674 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 15:03:05,674 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34899,1676127776785' in zk 2023-02-11 15:03:05,675 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,675 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:05,677 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,677 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 15:03:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:05,677 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:05,677 DEBUG [member: 'jenkins-hbase4.apache.org,36831,1676127776738' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 15:03:05,678 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 15:03:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:05,678 DEBUG [member: 'jenkins-hbase4.apache.org,34899,1676127776785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 15:03:05,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:05,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:05,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36831,1676127776738': 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36831,1676127776738' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:05,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:05,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34899,1676127776785': 2023-02-11 15:03:05,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34899,1676127776785' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 15:03:05,686 INFO [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 15:03:05,686 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:05,686 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:05,686 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 15:03:05,686 INFO [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:05,688 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:05,688 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:05,688 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,688 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:05,689 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:05,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,690 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,691 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:05,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:05,692 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-11 15:03:05,693 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,693 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:05,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:05,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:05,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:05,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 15:03:05,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:05,700 DEBUG [(jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:05,700 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:05,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:05,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:05,701 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,701 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:05,701 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:05,701 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:05,702 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:05,703 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:05,803 DEBUG [Listener at localhost/36917] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:05,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:05,916 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop-8568733910140241578.jar 2023-02-11 15:03:05,933 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676127782612 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:05,934 DEBUG [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce 2023-02-11 15:03:05,935 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:05,935 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:05,935 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(239): region to add: d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:05,936 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=df2de8d6db2cb3d0386ed041bdad062c as df2de8d6db2cb3d0386ed041bdad062c in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=7503a4fa390b8a04141ec816adc41c0e as 7503a4fa390b8a04141ec816adc41c0e in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=8e703d5836b126f747f8c19fd1af0a52 as 8e703d5836b126f747f8c19fd1af0a52 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=08e5a362688ef0542fddc405a6c467b0 as 08e5a362688ef0542fddc405a6c467b0 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=469d3054dd21983cfad82fb29e410366 as 469d3054dd21983cfad82fb29e410366 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=806043054b417df07e85f9a4c0591531 as 806043054b417df07e85f9a4c0591531 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=c3f13a385e6198b8d8fd26b55fd70399 as c3f13a385e6198b8d8fd26b55fd70399 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=ff12effb8ed95b33aa54963a1f518e5b as ff12effb8ed95b33aa54963a1f518e5b in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,937 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=f6737ecdfb37bb096214e8d49d370465 as f6737ecdfb37bb096214e8d49d370465 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,938 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(585): clone region=d07bc8a765b8863b21b3930145a3dca4 as d07bc8a765b8863b21b3930145a3dca4 in snapshot testWithMapReduceMultiRegion 2023-02-11 15:03:05,940 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 806043054b417df07e85f9a4c0591531, NAME => 'testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,941 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => df2de8d6db2cb3d0386ed041bdad062c, NAME => 'testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,941 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c3f13a385e6198b8d8fd26b55fd70399, NAME => 'testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,941 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 08e5a362688ef0542fddc405a6c467b0, NAME => 'testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,942 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8e703d5836b126f747f8c19fd1af0a52, NAME => 'testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,942 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7503a4fa390b8a04141ec816adc41c0e, NAME => 'testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,942 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 469d3054dd21983cfad82fb29e410366, NAME => 'testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,942 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => ff12effb8ed95b33aa54963a1f518e5b, NAME => 'testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,972 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:05,973 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0051aefd765b42838cc9b615402d4678 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:05,981 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:05,981 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c5a69dd1340147e0a2322ae24104ec6d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:05,986 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8bb404f219024d5aaf0bef51cc0374fb from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:05,987 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a975b2496198407994aa9f76fa27314d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:05,987 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:05,987 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b39657b5e3d545b6bc82e94062268d8a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:05,987 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:05,988 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7503a4fa390b8a04141ec816adc41c0e, disabling compactions & flushes 2023-02-11 15:03:05,988 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:05,988 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:05,988 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. after waiting 0 ms 2023-02-11 15:03:05,988 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:05,988 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:05,988 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7503a4fa390b8a04141ec816adc41c0e: Waiting for close lock at 1676127785988Disabling compacts and flushes for region at 1676127785988Disabling writes for close at 1676127785988Writing region close event to WAL at 1676127785988Closed at 1676127785988 2023-02-11 15:03:05,989 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => f6737ecdfb37bb096214e8d49d370465, NAME => 'testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,990 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 469d3054dd21983cfad82fb29e410366, disabling compactions & flushes 2023-02-11 15:03:05,990 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:05,991 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:05,991 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. after waiting 0 ms 2023-02-11 15:03:05,991 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:05,991 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:05,991 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 469d3054dd21983cfad82fb29e410366: Waiting for close lock at 1676127785990Disabling compacts and flushes for region at 1676127785990Disabling writes for close at 1676127785991 (+1 ms)Writing region close event to WAL at 1676127785991Closed at 1676127785991 2023-02-11 15:03:05,991 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => d07bc8a765b8863b21b3930145a3dca4, NAME => 'testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:05,991 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c3f13a385e6198b8d8fd26b55fd70399, disabling compactions & flushes 2023-02-11 15:03:05,992 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:05,992 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:05,992 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. after waiting 0 ms 2023-02-11 15:03:05,992 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:05,992 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:05,992 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c3f13a385e6198b8d8fd26b55fd70399: Waiting for close lock at 1676127785991Disabling compacts and flushes for region at 1676127785991Disabling writes for close at 1676127785992 (+1 ms)Writing region close event to WAL at 1676127785992Closed at 1676127785992 2023-02-11 15:03:06,001 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 65ba9a2a9ea7413faf9e7a92a239c742 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,002 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:06,002 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:06,002 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1aee6990168c4d249a5c8f77f392fe7b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,003 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1dda6636892406588d5dcd50097ba75 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,005 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:06,006 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 806043054b417df07e85f9a4c0591531, disabling compactions & flushes 2023-02-11 15:03:06,006 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:06,006 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:06,006 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. after waiting 0 ms 2023-02-11 15:03:06,006 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:06,006 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:06,006 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 806043054b417df07e85f9a4c0591531: Waiting for close lock at 1676127786006Disabling compacts and flushes for region at 1676127786006Disabling writes for close at 1676127786006Writing region close event to WAL at 1676127786006Closed at 1676127786006 2023-02-11 15:03:06,015 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 93c4071c8f464336ae4d42216f0a21e9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,015 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3c9b6a6173044400a55908f905477804 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,015 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 08e5a362688ef0542fddc405a6c467b0, disabling compactions & flushes 2023-02-11 15:03:06,016 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:06,016 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:06,016 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. after waiting 0 ms 2023-02-11 15:03:06,016 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:06,016 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:06,016 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 08e5a362688ef0542fddc405a6c467b0: Waiting for close lock at 1676127786015Disabling compacts and flushes for region at 1676127786015Disabling writes for close at 1676127786016 (+1 ms)Writing region close event to WAL at 1676127786016Closed at 1676127786016 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:06,019 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink edc8b439e1d94f059daab7027009bf3b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8e703d5836b126f747f8c19fd1af0a52, disabling compactions & flushes 2023-02-11 15:03:06,019 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. after waiting 0 ms 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing ff12effb8ed95b33aa54963a1f518e5b, disabling compactions & flushes 2023-02-11 15:03:06,019 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:06,019 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8e703d5836b126f747f8c19fd1af0a52: Waiting for close lock at 1676127786019Disabling compacts and flushes for region at 1676127786019Disabling writes for close at 1676127786019Writing region close event to WAL at 1676127786019Closed at 1676127786019 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. after waiting 0 ms 2023-02-11 15:03:06,019 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:06,020 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:06,020 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for ff12effb8ed95b33aa54963a1f518e5b: Waiting for close lock at 1676127786019Disabling compacts and flushes for region at 1676127786019Disabling writes for close at 1676127786019Writing region close event to WAL at 1676127786020 (+1 ms)Closed at 1676127786020 2023-02-11 15:03:06,021 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:06,021 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ef2014e17c9648e28c23bea812c97056 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,021 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5fcac02cc6fd429fbd559fd9cda17fb4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,024 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 15ec229bd1de4ceaa7dde1e7ac43e151 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,024 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing d07bc8a765b8863b21b3930145a3dca4, disabling compactions & flushes 2023-02-11 15:03:06,024 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:06,024 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:06,024 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. after waiting 0 ms 2023-02-11 15:03:06,024 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:06,024 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:06,024 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for d07bc8a765b8863b21b3930145a3dca4: Waiting for close lock at 1676127786024Disabling compacts and flushes for region at 1676127786024Disabling writes for close at 1676127786024Writing region close event to WAL at 1676127786024Closed at 1676127786024 2023-02-11 15:03:06,025 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing f6737ecdfb37bb096214e8d49d370465, disabling compactions & flushes 2023-02-11 15:03:06,026 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:06,026 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:06,026 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. after waiting 0 ms 2023-02-11 15:03:06,026 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:06,026 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:06,026 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for f6737ecdfb37bb096214e8d49d370465: Waiting for close lock at 1676127786025Disabling compacts and flushes for region at 1676127786025Disabling writes for close at 1676127786026 (+1 ms)Writing region close event to WAL at 1676127786026Closed at 1676127786026 2023-02-11 15:03:06,384 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:06,385 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4f3cfc9485d6404aa62d2b710177b48f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,391 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fa6cffdc56524c7ba3ea4c24e38e6e71 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-11 15:03:06,396 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing df2de8d6db2cb3d0386ed041bdad062c, disabling compactions & flushes 2023-02-11 15:03:06,396 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:06,397 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:06,397 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. after waiting 0 ms 2023-02-11 15:03:06,397 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:06,397 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:06,397 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for df2de8d6db2cb3d0386ed041bdad062c: Waiting for close lock at 1676127786396Disabling compacts and flushes for region at 1676127786396Disabling writes for close at 1676127786397 (+1 ms)Writing region close event to WAL at 1676127786397Closed at 1676127786397 2023-02-11 15:03:06,397 INFO [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676127782612 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:06,397 DEBUG [Listener at localhost/36917] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:06,397 DEBUG [Listener at localhost/36917] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890 2023-02-11 15:03:06,398 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:06,399 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:06,399 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 15:03:06,400 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------08e5a362688ef0542fddc405a6c467b0/ 2023-02-11 15:03:06,400 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,401 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,401 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=08e5a362688ef0542fddc405a6c467b0-b39657b5e3d545b6bc82e94062268d8a 2023-02-11 15:03:06,401 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,402 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=08e5a362688ef0542fddc405a6c467b0-65ba9a2a9ea7413faf9e7a92a239c742 2023-02-11 15:03:06,402 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------469d3054dd21983cfad82fb29e410366/ 2023-02-11 15:03:06,402 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,402 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,403 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=469d3054dd21983cfad82fb29e410366-0051aefd765b42838cc9b615402d4678 2023-02-11 15:03:06,403 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,403 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=469d3054dd21983cfad82fb29e410366-8bb404f219024d5aaf0bef51cc0374fb 2023-02-11 15:03:06,403 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------7503a4fa390b8a04141ec816adc41c0e/ 2023-02-11 15:03:06,404 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,404 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------806043054b417df07e85f9a4c0591531/ 2023-02-11 15:03:06,404 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,405 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------8e703d5836b126f747f8c19fd1af0a52/ 2023-02-11 15:03:06,405 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,405 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,406 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=8e703d5836b126f747f8c19fd1af0a52-1aee6990168c4d249a5c8f77f392fe7b 2023-02-11 15:03:06,406 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,406 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=8e703d5836b126f747f8c19fd1af0a52-93c4071c8f464336ae4d42216f0a21e9 2023-02-11 15:03:06,406 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------c3f13a385e6198b8d8fd26b55fd70399/ 2023-02-11 15:03:06,409 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,409 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,410 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=c3f13a385e6198b8d8fd26b55fd70399-c5a69dd1340147e0a2322ae24104ec6d 2023-02-11 15:03:06,410 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,410 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=c3f13a385e6198b8d8fd26b55fd70399-a975b2496198407994aa9f76fa27314d 2023-02-11 15:03:06,410 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------d07bc8a765b8863b21b3930145a3dca4/ 2023-02-11 15:03:06,411 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,411 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,411 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=d07bc8a765b8863b21b3930145a3dca4-edc8b439e1d94f059daab7027009bf3b 2023-02-11 15:03:06,412 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,412 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=d07bc8a765b8863b21b3930145a3dca4-5fcac02cc6fd429fbd559fd9cda17fb4 2023-02-11 15:03:06,412 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------df2de8d6db2cb3d0386ed041bdad062c/ 2023-02-11 15:03:06,413 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,413 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,413 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=df2de8d6db2cb3d0386ed041bdad062c-4f3cfc9485d6404aa62d2b710177b48f 2023-02-11 15:03:06,413 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,414 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=df2de8d6db2cb3d0386ed041bdad062c-fa6cffdc56524c7ba3ea4c24e38e6e71 2023-02-11 15:03:06,414 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------f6737ecdfb37bb096214e8d49d370465/ 2023-02-11 15:03:06,414 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,414 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,415 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=f6737ecdfb37bb096214e8d49d370465-ef2014e17c9648e28c23bea812c97056 2023-02-11 15:03:06,415 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,416 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=f6737ecdfb37bb096214e8d49d370465-15ec229bd1de4ceaa7dde1e7ac43e151 2023-02-11 15:03:06,416 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |----------ff12effb8ed95b33aa54963a1f518e5b/ 2023-02-11 15:03:06,416 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:06,416 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:06,417 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=ff12effb8ed95b33aa54963a1f518e5b-f1dda6636892406588d5dcd50097ba75 2023-02-11 15:03:06,417 DEBUG [Listener at localhost/36917] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:06,418 DEBUG [Listener at localhost/36917] util.CommonFSUtils(702): |----------------testWithMapReduce=ff12effb8ed95b33aa54963a1f518e5b-3c9b6a6173044400a55908f905477804 2023-02-11 15:03:06,432 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:06,433 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:06,434 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:06,434 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,459 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop-7120892697591680189.jar 2023-02-11 15:03:07,459 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,460 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,536 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop-2744814747734268569.jar 2023-02-11 15:03:07,537 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,538 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,538 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,539 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,540 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,540 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,541 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 15:03:07,541 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 15:03:07,542 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 15:03:07,542 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 15:03:07,543 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 15:03:07,544 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 15:03:07,544 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 15:03:07,544 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 15:03:07,545 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 15:03:07,545 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 15:03:07,552 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:07,552 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:07,553 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:07,553 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:07,554 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 15:03:07,633 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop-2479835189979685639.jar 2023-02-11 15:03:07,633 DEBUG [Listener at localhost/36917] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 15:03:07,695 WARN [Listener at localhost/36917] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 15:03:07,716 WARN [Listener at localhost/36917] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-11 15:03:07,732 INFO [Listener at localhost/36917] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 15:03:08,157 WARN [Listener at localhost/36917] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/mapreduce.cluster.local.dir/1676127788077/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 15:03:08,157 WARN [Listener at localhost/36917] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/mapreduce.cluster.local.dir/1676127788077/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 15:03:08,325 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,325 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,331 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,334 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:08,335 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1 2023-02-11 15:03:08,335 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e5a362688ef0542fddc405a6c467b0 columnFamilyName f1 2023-02-11 15:03:08,343 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/testWithMapReduce=08e5a362688ef0542fddc405a6c467b0-b39657b5e3d545b6bc82e94062268d8a 2023-02-11 15:03:08,344 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(310): Store=08e5a362688ef0542fddc405a6c467b0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,344 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:08,346 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2 2023-02-11 15:03:08,346 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08e5a362688ef0542fddc405a6c467b0 columnFamilyName f2 2023-02-11 15:03:08,352 DEBUG [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/testWithMapReduce=08e5a362688ef0542fddc405a6c467b0-65ba9a2a9ea7413faf9e7a92a239c742 2023-02-11 15:03:08,353 INFO [StoreOpener-08e5a362688ef0542fddc405a6c467b0-1] regionserver.HStore(310): Store=08e5a362688ef0542fddc405a6c467b0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,353 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08e5a362688ef0542fddc405a6c467b0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62060568, jitterRate=-0.07522547245025635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,353 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08e5a362688ef0542fddc405a6c467b0: Writing region info on filesystem at 1676127788331Initializing all the Stores at 1676127788333 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788333Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788333Region opened successfully at 1676127788353 (+20 ms) 2023-02-11 15:03:08,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08e5a362688ef0542fddc405a6c467b0, disabling compactions & flushes 2023-02-11 15:03:08,547 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:08,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:08,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. after waiting 0 ms 2023-02-11 15:03:08,547 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:08,551 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:08,552 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08e5a362688ef0542fddc405a6c467b0: Waiting for close lock at 1676127788547Disabling compacts and flushes for region at 1676127788547Disabling writes for close at 1676127788547Writing region close event to WAL at 1676127788551 (+4 ms)Closed at 1676127788551 2023-02-11 15:03:08,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,571 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,572 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,575 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:08,576 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1 2023-02-11 15:03:08,577 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469d3054dd21983cfad82fb29e410366 columnFamilyName f1 2023-02-11 15:03:08,584 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/testWithMapReduce=469d3054dd21983cfad82fb29e410366-0051aefd765b42838cc9b615402d4678 2023-02-11 15:03:08,584 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(310): Store=469d3054dd21983cfad82fb29e410366/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,585 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:08,586 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2 2023-02-11 15:03:08,586 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 469d3054dd21983cfad82fb29e410366 columnFamilyName f2 2023-02-11 15:03:08,594 DEBUG [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/testWithMapReduce=469d3054dd21983cfad82fb29e410366-8bb404f219024d5aaf0bef51cc0374fb 2023-02-11 15:03:08,594 INFO [StoreOpener-469d3054dd21983cfad82fb29e410366-1] regionserver.HStore(310): Store=469d3054dd21983cfad82fb29e410366/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,595 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 469d3054dd21983cfad82fb29e410366; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73432159, jitterRate=0.09422443807125092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,595 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 469d3054dd21983cfad82fb29e410366: Writing region info on filesystem at 1676127788572Initializing all the Stores at 1676127788574 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788574Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788574Region opened successfully at 1676127788595 (+21 ms) 2023-02-11 15:03:08,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 469d3054dd21983cfad82fb29e410366, disabling compactions & flushes 2023-02-11 15:03:08,649 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:08,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:08,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. after waiting 0 ms 2023-02-11 15:03:08,650 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:08,653 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:08,653 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 469d3054dd21983cfad82fb29e410366: Waiting for close lock at 1676127788649Disabling compacts and flushes for region at 1676127788649Disabling writes for close at 1676127788650 (+1 ms)Writing region close event to WAL at 1676127788653 (+3 ms)Closed at 1676127788653 2023-02-11 15:03:08,659 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,659 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,663 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,665 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:08,667 DEBUG [StoreOpener-806043054b417df07e85f9a4c0591531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f1 2023-02-11 15:03:08,668 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 806043054b417df07e85f9a4c0591531 columnFamilyName f1 2023-02-11 15:03:08,669 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(310): Store=806043054b417df07e85f9a4c0591531/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,669 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:08,670 DEBUG [StoreOpener-806043054b417df07e85f9a4c0591531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f2 2023-02-11 15:03:08,671 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 806043054b417df07e85f9a4c0591531 columnFamilyName f2 2023-02-11 15:03:08,671 INFO [StoreOpener-806043054b417df07e85f9a4c0591531-1] regionserver.HStore(310): Store=806043054b417df07e85f9a4c0591531/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,672 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 806043054b417df07e85f9a4c0591531; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72014437, jitterRate=0.07309873402118683}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 806043054b417df07e85f9a4c0591531: Writing region info on filesystem at 1676127788663Initializing all the Stores at 1676127788665 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788665Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788665Region opened successfully at 1676127788672 (+7 ms) 2023-02-11 15:03:08,728 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 806043054b417df07e85f9a4c0591531, disabling compactions & flushes 2023-02-11 15:03:08,728 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:08,728 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:08,728 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. after waiting 0 ms 2023-02-11 15:03:08,728 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:08,729 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:08,729 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 806043054b417df07e85f9a4c0591531: Waiting for close lock at 1676127788728Disabling compacts and flushes for region at 1676127788728Disabling writes for close at 1676127788728Writing region close event to WAL at 1676127788729 (+1 ms)Closed at 1676127788729 2023-02-11 15:03:08,735 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,735 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,736 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,738 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:08,740 DEBUG [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f1 2023-02-11 15:03:08,741 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7503a4fa390b8a04141ec816adc41c0e columnFamilyName f1 2023-02-11 15:03:08,741 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(310): Store=7503a4fa390b8a04141ec816adc41c0e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,741 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:08,743 DEBUG [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f2 2023-02-11 15:03:08,744 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7503a4fa390b8a04141ec816adc41c0e columnFamilyName f2 2023-02-11 15:03:08,745 INFO [StoreOpener-7503a4fa390b8a04141ec816adc41c0e-1] regionserver.HStore(310): Store=7503a4fa390b8a04141ec816adc41c0e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,745 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7503a4fa390b8a04141ec816adc41c0e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64788555, jitterRate=-0.03457529842853546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,745 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7503a4fa390b8a04141ec816adc41c0e: Writing region info on filesystem at 1676127788736Initializing all the Stores at 1676127788737 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788738 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788738Region opened successfully at 1676127788745 (+7 ms) 2023-02-11 15:03:08,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7503a4fa390b8a04141ec816adc41c0e, disabling compactions & flushes 2023-02-11 15:03:08,764 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:08,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:08,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. after waiting 0 ms 2023-02-11 15:03:08,764 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:08,765 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:08,765 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7503a4fa390b8a04141ec816adc41c0e: Waiting for close lock at 1676127788764Disabling compacts and flushes for region at 1676127788764Disabling writes for close at 1676127788764Writing region close event to WAL at 1676127788765 (+1 ms)Closed at 1676127788765 2023-02-11 15:03:08,770 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,771 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,772 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,776 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:08,777 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1 2023-02-11 15:03:08,778 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff12effb8ed95b33aa54963a1f518e5b columnFamilyName f1 2023-02-11 15:03:08,783 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/testWithMapReduce=ff12effb8ed95b33aa54963a1f518e5b-f1dda6636892406588d5dcd50097ba75 2023-02-11 15:03:08,784 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(310): Store=ff12effb8ed95b33aa54963a1f518e5b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,784 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:08,785 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2 2023-02-11 15:03:08,785 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff12effb8ed95b33aa54963a1f518e5b columnFamilyName f2 2023-02-11 15:03:08,791 DEBUG [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/testWithMapReduce=ff12effb8ed95b33aa54963a1f518e5b-3c9b6a6173044400a55908f905477804 2023-02-11 15:03:08,791 INFO [StoreOpener-ff12effb8ed95b33aa54963a1f518e5b-1] regionserver.HStore(310): Store=ff12effb8ed95b33aa54963a1f518e5b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ff12effb8ed95b33aa54963a1f518e5b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68283386, jitterRate=0.017501741647720337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ff12effb8ed95b33aa54963a1f518e5b: Writing region info on filesystem at 1676127788772Initializing all the Stores at 1676127788773 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788773Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788775 (+2 ms)Region opened successfully at 1676127788792 (+17 ms) 2023-02-11 15:03:08,827 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ff12effb8ed95b33aa54963a1f518e5b, disabling compactions & flushes 2023-02-11 15:03:08,828 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:08,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:08,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. after waiting 0 ms 2023-02-11 15:03:08,829 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:08,833 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:08,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ff12effb8ed95b33aa54963a1f518e5b: Waiting for close lock at 1676127788827Disabling compacts and flushes for region at 1676127788827Disabling writes for close at 1676127788829 (+2 ms)Writing region close event to WAL at 1676127788833 (+4 ms)Closed at 1676127788833 2023-02-11 15:03:08,839 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,839 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,840 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,842 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:08,843 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1 2023-02-11 15:03:08,844 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f13a385e6198b8d8fd26b55fd70399 columnFamilyName f1 2023-02-11 15:03:08,850 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/testWithMapReduce=c3f13a385e6198b8d8fd26b55fd70399-c5a69dd1340147e0a2322ae24104ec6d 2023-02-11 15:03:08,850 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(310): Store=c3f13a385e6198b8d8fd26b55fd70399/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,850 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:08,851 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2 2023-02-11 15:03:08,852 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3f13a385e6198b8d8fd26b55fd70399 columnFamilyName f2 2023-02-11 15:03:08,858 DEBUG [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/testWithMapReduce=c3f13a385e6198b8d8fd26b55fd70399-a975b2496198407994aa9f76fa27314d 2023-02-11 15:03:08,859 INFO [StoreOpener-c3f13a385e6198b8d8fd26b55fd70399-1] regionserver.HStore(310): Store=c3f13a385e6198b8d8fd26b55fd70399/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,859 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c3f13a385e6198b8d8fd26b55fd70399; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63187161, jitterRate=-0.058437928557395935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,859 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c3f13a385e6198b8d8fd26b55fd70399: Writing region info on filesystem at 1676127788840Initializing all the Stores at 1676127788841 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788842 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788842Region opened successfully at 1676127788859 (+17 ms) 2023-02-11 15:03:08,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c3f13a385e6198b8d8fd26b55fd70399, disabling compactions & flushes 2023-02-11 15:03:08,897 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:08,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:08,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. after waiting 0 ms 2023-02-11 15:03:08,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:08,900 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:08,900 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c3f13a385e6198b8d8fd26b55fd70399: Waiting for close lock at 1676127788897Disabling compacts and flushes for region at 1676127788897Disabling writes for close at 1676127788897Writing region close event to WAL at 1676127788900 (+3 ms)Closed at 1676127788900 2023-02-11 15:03:08,905 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,905 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,908 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:08,910 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:08,911 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1 2023-02-11 15:03:08,911 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07bc8a765b8863b21b3930145a3dca4 columnFamilyName f1 2023-02-11 15:03:08,918 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/testWithMapReduce=d07bc8a765b8863b21b3930145a3dca4-edc8b439e1d94f059daab7027009bf3b 2023-02-11 15:03:08,918 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(310): Store=d07bc8a765b8863b21b3930145a3dca4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,918 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:08,919 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2 2023-02-11 15:03:08,919 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07bc8a765b8863b21b3930145a3dca4 columnFamilyName f2 2023-02-11 15:03:08,927 DEBUG [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/testWithMapReduce=d07bc8a765b8863b21b3930145a3dca4-5fcac02cc6fd429fbd559fd9cda17fb4 2023-02-11 15:03:08,927 INFO [StoreOpener-d07bc8a765b8863b21b3930145a3dca4-1] regionserver.HStore(310): Store=d07bc8a765b8863b21b3930145a3dca4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:08,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:08,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d07bc8a765b8863b21b3930145a3dca4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68998535, jitterRate=0.028158292174339294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:08,927 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d07bc8a765b8863b21b3930145a3dca4: Writing region info on filesystem at 1676127788908Initializing all the Stores at 1676127788909 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788909Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127788909Region opened successfully at 1676127788927 (+18 ms) 2023-02-11 15:03:08,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d07bc8a765b8863b21b3930145a3dca4, disabling compactions & flushes 2023-02-11 15:03:08,984 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:08,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. after waiting 0 ms 2023-02-11 15:03:08,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:08,988 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:08,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d07bc8a765b8863b21b3930145a3dca4: Waiting for close lock at 1676127788984Disabling compacts and flushes for region at 1676127788984Disabling writes for close at 1676127788985 (+1 ms)Writing region close event to WAL at 1676127788988 (+3 ms)Closed at 1676127788988 2023-02-11 15:03:08,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:08,995 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:08,999 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:09,001 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:09,002 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1 2023-02-11 15:03:09,003 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e703d5836b126f747f8c19fd1af0a52 columnFamilyName f1 2023-02-11 15:03:09,010 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/testWithMapReduce=8e703d5836b126f747f8c19fd1af0a52-1aee6990168c4d249a5c8f77f392fe7b 2023-02-11 15:03:09,011 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(310): Store=8e703d5836b126f747f8c19fd1af0a52/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:09,011 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:09,012 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2 2023-02-11 15:03:09,012 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e703d5836b126f747f8c19fd1af0a52 columnFamilyName f2 2023-02-11 15:03:09,019 DEBUG [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/testWithMapReduce=8e703d5836b126f747f8c19fd1af0a52-93c4071c8f464336ae4d42216f0a21e9 2023-02-11 15:03:09,019 INFO [StoreOpener-8e703d5836b126f747f8c19fd1af0a52-1] regionserver.HStore(310): Store=8e703d5836b126f747f8c19fd1af0a52/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:09,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:09,019 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8e703d5836b126f747f8c19fd1af0a52; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71984904, jitterRate=0.07265865802764893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:09,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8e703d5836b126f747f8c19fd1af0a52: Writing region info on filesystem at 1676127788999Initializing all the Stores at 1676127789000 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127789000Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127789001 (+1 ms)Region opened successfully at 1676127789019 (+18 ms) 2023-02-11 15:03:09,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8e703d5836b126f747f8c19fd1af0a52, disabling compactions & flushes 2023-02-11 15:03:09,054 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:09,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:09,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. after waiting 0 ms 2023-02-11 15:03:09,054 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:09,061 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:09,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8e703d5836b126f747f8c19fd1af0a52: Waiting for close lock at 1676127789054Disabling compacts and flushes for region at 1676127789054Disabling writes for close at 1676127789054Writing region close event to WAL at 1676127789061 (+7 ms)Closed at 1676127789061 2023-02-11 15:03:09,066 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:09,066 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:09,067 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:09,070 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:09,071 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1 2023-02-11 15:03:09,071 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df2de8d6db2cb3d0386ed041bdad062c columnFamilyName f1 2023-02-11 15:03:09,078 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/testWithMapReduce=df2de8d6db2cb3d0386ed041bdad062c-4f3cfc9485d6404aa62d2b710177b48f 2023-02-11 15:03:09,079 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(310): Store=df2de8d6db2cb3d0386ed041bdad062c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:09,079 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:09,080 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2 2023-02-11 15:03:09,080 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df2de8d6db2cb3d0386ed041bdad062c columnFamilyName f2 2023-02-11 15:03:09,087 DEBUG [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/testWithMapReduce=df2de8d6db2cb3d0386ed041bdad062c-fa6cffdc56524c7ba3ea4c24e38e6e71 2023-02-11 15:03:09,087 INFO [StoreOpener-df2de8d6db2cb3d0386ed041bdad062c-1] regionserver.HStore(310): Store=df2de8d6db2cb3d0386ed041bdad062c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:09,087 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:09,087 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened df2de8d6db2cb3d0386ed041bdad062c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67359092, jitterRate=0.0037286877632141113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:09,087 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for df2de8d6db2cb3d0386ed041bdad062c: Writing region info on filesystem at 1676127789068Initializing all the Stores at 1676127789069 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127789069Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127789069Region opened successfully at 1676127789087 (+18 ms) 2023-02-11 15:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing df2de8d6db2cb3d0386ed041bdad062c, disabling compactions & flushes 2023-02-11 15:03:09,119 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. after waiting 0 ms 2023-02-11 15:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:09,122 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:09,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for df2de8d6db2cb3d0386ed041bdad062c: Waiting for close lock at 1676127789119Disabling compacts and flushes for region at 1676127789119Disabling writes for close at 1676127789119Writing region close event to WAL at 1676127789122 (+3 ms)Closed at 1676127789122 2023-02-11 15:03:09,126 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:09,126 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:09,127 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:09,131 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:09,132 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1 2023-02-11 15:03:09,132 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6737ecdfb37bb096214e8d49d370465 columnFamilyName f1 2023-02-11 15:03:09,138 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/testWithMapReduce=f6737ecdfb37bb096214e8d49d370465-ef2014e17c9648e28c23bea812c97056 2023-02-11 15:03:09,138 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(310): Store=f6737ecdfb37bb096214e8d49d370465/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:09,138 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:09,139 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2 2023-02-11 15:03:09,140 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6737ecdfb37bb096214e8d49d370465 columnFamilyName f2 2023-02-11 15:03:09,145 DEBUG [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(539): loaded hdfs://localhost:44609/user/jenkins/test-data/1d535868-35df-c364-e309-9f6288b6633e/testWithMapReduceMultiRegion/d077b290-9355-46e1-8021-ca3ecdac8890/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/testWithMapReduce=f6737ecdfb37bb096214e8d49d370465-15ec229bd1de4ceaa7dde1e7ac43e151 2023-02-11 15:03:09,145 INFO [StoreOpener-f6737ecdfb37bb096214e8d49d370465-1] regionserver.HStore(310): Store=f6737ecdfb37bb096214e8d49d370465/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:09,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:09,146 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f6737ecdfb37bb096214e8d49d370465; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66596509, jitterRate=-0.007634684443473816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:09,146 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f6737ecdfb37bb096214e8d49d370465: Writing region info on filesystem at 1676127789127Initializing all the Stores at 1676127789128 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127789128Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127789130 (+2 ms)Region opened successfully at 1676127789146 (+16 ms) 2023-02-11 15:03:09,173 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f6737ecdfb37bb096214e8d49d370465, disabling compactions & flushes 2023-02-11 15:03:09,174 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:09,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:09,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. after waiting 0 ms 2023-02-11 15:03:09,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:09,177 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:09,177 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f6737ecdfb37bb096214e8d49d370465: Waiting for close lock at 1676127789173Disabling compacts and flushes for region at 1676127789173Disabling writes for close at 1676127789174 (+1 ms)Writing region close event to WAL at 1676127789177 (+3 ms)Closed at 1676127789177 2023-02-11 15:03:10,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-11 15:03:10,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-11 15:03:10,252 INFO [Listener at localhost/36917] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 15:03:10,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 15:03:10,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-11 15:03:10,265 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127790265"}]},"ts":"1676127790265"} 2023-02-11 15:03:10,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:10,267 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-11 15:03:10,270 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-11 15:03:10,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, UNASSIGN}] 2023-02-11 15:03:10,284 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, UNASSIGN 2023-02-11 15:03:10,297 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7503a4fa390b8a04141ec816adc41c0e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:10,297 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127790297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790297"}]},"ts":"1676127790297"} 2023-02-11 15:03:10,299 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, UNASSIGN 2023-02-11 15:03:10,300 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, UNASSIGN 2023-02-11 15:03:10,300 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, UNASSIGN 2023-02-11 15:03:10,300 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, UNASSIGN 2023-02-11 15:03:10,302 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=08e5a362688ef0542fddc405a6c467b0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:10,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790302"}]},"ts":"1676127790302"} 2023-02-11 15:03:10,303 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d07bc8a765b8863b21b3930145a3dca4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:10,303 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790303"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790303"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790303"}]},"ts":"1676127790303"} 2023-02-11 15:03:10,303 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=8e703d5836b126f747f8c19fd1af0a52, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:10,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790303"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790303"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790303"}]},"ts":"1676127790303"} 2023-02-11 15:03:10,304 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ff12effb8ed95b33aa54963a1f518e5b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:10,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 7503a4fa390b8a04141ec816adc41c0e, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:10,304 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790304"}]},"ts":"1676127790304"} 2023-02-11 15:03:10,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=42, state=RUNNABLE; CloseRegionProcedure 08e5a362688ef0542fddc405a6c467b0, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:10,315 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=41, state=RUNNABLE; CloseRegionProcedure d07bc8a765b8863b21b3930145a3dca4, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:10,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure 8e703d5836b126f747f8c19fd1af0a52, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:10,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=40, state=RUNNABLE; CloseRegionProcedure ff12effb8ed95b33aa54963a1f518e5b, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:10,321 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, UNASSIGN 2023-02-11 15:03:10,322 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, UNASSIGN 2023-02-11 15:03:10,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f6737ecdfb37bb096214e8d49d370465, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:10,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790324"}]},"ts":"1676127790324"} 2023-02-11 15:03:10,325 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, UNASSIGN 2023-02-11 15:03:10,325 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c3f13a385e6198b8d8fd26b55fd70399, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:10,325 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790325"}]},"ts":"1676127790325"} 2023-02-11 15:03:10,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure f6737ecdfb37bb096214e8d49d370465, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:10,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=38, state=RUNNABLE; CloseRegionProcedure c3f13a385e6198b8d8fd26b55fd70399, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:10,329 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, UNASSIGN 2023-02-11 15:03:10,330 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=469d3054dd21983cfad82fb29e410366, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:10,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676127780829.469d3054dd21983cfad82fb29e410366.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790329"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790329"}]},"ts":"1676127790329"} 2023-02-11 15:03:10,330 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, UNASSIGN 2023-02-11 15:03:10,332 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=df2de8d6db2cb3d0386ed041bdad062c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:10,332 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=806043054b417df07e85f9a4c0591531, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:10,332 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790332"}]},"ts":"1676127790332"} 2023-02-11 15:03:10,333 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127790332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127790332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127790332"}]},"ts":"1676127790332"} 2023-02-11 15:03:10,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 469d3054dd21983cfad82fb29e410366, server=jenkins-hbase4.apache.org,36831,1676127776738}] 2023-02-11 15:03:10,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure df2de8d6db2cb3d0386ed041bdad062c, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:10,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 806043054b417df07e85f9a4c0591531, server=jenkins-hbase4.apache.org,34899,1676127776785}] 2023-02-11 15:03:10,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:10,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:10,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d07bc8a765b8863b21b3930145a3dca4, disabling compactions & flushes 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8e703d5836b126f747f8c19fd1af0a52, disabling compactions & flushes 2023-02-11 15:03:10,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:10,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. after waiting 0 ms 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. after waiting 0 ms 2023-02-11 15:03:10,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:10,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4. 2023-02-11 15:03:10,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d07bc8a765b8863b21b3930145a3dca4: Waiting for close lock at 1676127790471Running coprocessor pre-close hooks at 1676127790471Disabling compacts and flushes for region at 1676127790471Disabling writes for close at 1676127790471Writing region close event to WAL at 1676127790478 (+7 ms)Running coprocessor post-close hooks at 1676127790488 (+10 ms)Closed at 1676127790489 (+1 ms) 2023-02-11 15:03:10,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52. 2023-02-11 15:03:10,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8e703d5836b126f747f8c19fd1af0a52: Waiting for close lock at 1676127790471Running coprocessor pre-close hooks at 1676127790471Disabling compacts and flushes for region at 1676127790471Disabling writes for close at 1676127790471Writing region close event to WAL at 1676127790479 (+8 ms)Running coprocessor post-close hooks at 1676127790489 (+10 ms)Closed at 1676127790490 (+1 ms) 2023-02-11 15:03:10,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:10,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:10,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f6737ecdfb37bb096214e8d49d370465, disabling compactions & flushes 2023-02-11 15:03:10,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:10,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:10,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. after waiting 0 ms 2023-02-11 15:03:10,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:10,492 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=d07bc8a765b8863b21b3930145a3dca4, regionState=CLOSED 2023-02-11 15:03:10,492 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790492"}]},"ts":"1676127790492"} 2023-02-11 15:03:10,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:10,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:10,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08e5a362688ef0542fddc405a6c467b0, disabling compactions & flushes 2023-02-11 15:03:10,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:10,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:10,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. after waiting 0 ms 2023-02-11 15:03:10,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:10,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=8e703d5836b126f747f8c19fd1af0a52, regionState=CLOSED 2023-02-11 15:03:10,493 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790493"}]},"ts":"1676127790493"} 2023-02-11 15:03:10,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=41 2023-02-11 15:03:10,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=41, state=SUCCESS; CloseRegionProcedure d07bc8a765b8863b21b3930145a3dca4, server=jenkins-hbase4.apache.org,36831,1676127776738 in 180 msec 2023-02-11 15:03:10,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-11 15:03:10,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure 8e703d5836b126f747f8c19fd1af0a52, server=jenkins-hbase4.apache.org,34899,1676127776785 in 178 msec 2023-02-11 15:03:10,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d07bc8a765b8863b21b3930145a3dca4, UNASSIGN in 227 msec 2023-02-11 15:03:10,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8e703d5836b126f747f8c19fd1af0a52, UNASSIGN in 230 msec 2023-02-11 15:03:10,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465. 2023-02-11 15:03:10,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f6737ecdfb37bb096214e8d49d370465: Waiting for close lock at 1676127790491Running coprocessor pre-close hooks at 1676127790491Disabling compacts and flushes for region at 1676127790491Disabling writes for close at 1676127790492 (+1 ms)Writing region close event to WAL at 1676127790499 (+7 ms)Running coprocessor post-close hooks at 1676127790506 (+7 ms)Closed at 1676127790507 (+1 ms) 2023-02-11 15:03:10,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:10,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c3f13a385e6198b8d8fd26b55fd70399, disabling compactions & flushes 2023-02-11 15:03:10,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:10,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:10,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. after waiting 0 ms 2023-02-11 15:03:10,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:10,509 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f6737ecdfb37bb096214e8d49d370465, regionState=CLOSED 2023-02-11 15:03:10,509 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790509"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790509"}]},"ts":"1676127790509"} 2023-02-11 15:03:10,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0. 2023-02-11 15:03:10,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08e5a362688ef0542fddc405a6c467b0: Waiting for close lock at 1676127790492Running coprocessor pre-close hooks at 1676127790492Disabling compacts and flushes for region at 1676127790492Disabling writes for close at 1676127790492Writing region close event to WAL at 1676127790504 (+12 ms)Running coprocessor post-close hooks at 1676127790510 (+6 ms)Closed at 1676127790516 (+6 ms) 2023-02-11 15:03:10,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-11 15:03:10,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure f6737ecdfb37bb096214e8d49d370465, server=jenkins-hbase4.apache.org,36831,1676127776738 in 183 msec 2023-02-11 15:03:10,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:10,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:10,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing df2de8d6db2cb3d0386ed041bdad062c, disabling compactions & flushes 2023-02-11 15:03:10,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:10,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:10,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. after waiting 0 ms 2023-02-11 15:03:10,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:10,523 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=08e5a362688ef0542fddc405a6c467b0, regionState=CLOSED 2023-02-11 15:03:10,523 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790523"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790523"}]},"ts":"1676127790523"} 2023-02-11 15:03:10,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f6737ecdfb37bb096214e8d49d370465, UNASSIGN in 249 msec 2023-02-11 15:03:10,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=42 2023-02-11 15:03:10,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=42, state=SUCCESS; CloseRegionProcedure 08e5a362688ef0542fddc405a6c467b0, server=jenkins-hbase4.apache.org,34899,1676127776785 in 216 msec 2023-02-11 15:03:10,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08e5a362688ef0542fddc405a6c467b0, UNASSIGN in 253 msec 2023-02-11 15:03:10,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399. 2023-02-11 15:03:10,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c3f13a385e6198b8d8fd26b55fd70399: Waiting for close lock at 1676127790508Running coprocessor pre-close hooks at 1676127790508Disabling compacts and flushes for region at 1676127790508Disabling writes for close at 1676127790509 (+1 ms)Writing region close event to WAL at 1676127790520 (+11 ms)Running coprocessor post-close hooks at 1676127790536 (+16 ms)Closed at 1676127790537 (+1 ms) 2023-02-11 15:03:10,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:10,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 469d3054dd21983cfad82fb29e410366, disabling compactions & flushes 2023-02-11 15:03:10,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. after waiting 0 ms 2023-02-11 15:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:10,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c3f13a385e6198b8d8fd26b55fd70399, regionState=CLOSED 2023-02-11 15:03:10,540 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790539"}]},"ts":"1676127790539"} 2023-02-11 15:03:10,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c. 2023-02-11 15:03:10,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for df2de8d6db2cb3d0386ed041bdad062c: Waiting for close lock at 1676127790522Running coprocessor pre-close hooks at 1676127790522Disabling compacts and flushes for region at 1676127790522Disabling writes for close at 1676127790522Writing region close event to WAL at 1676127790535 (+13 ms)Running coprocessor post-close hooks at 1676127790540 (+5 ms)Closed at 1676127790541 (+1 ms) 2023-02-11 15:03:10,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:10,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 806043054b417df07e85f9a4c0591531, disabling compactions & flushes 2023-02-11 15:03:10,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. after waiting 0 ms 2023-02-11 15:03:10,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:10,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=df2de8d6db2cb3d0386ed041bdad062c, regionState=CLOSED 2023-02-11 15:03:10,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790544"}]},"ts":"1676127790544"} 2023-02-11 15:03:10,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=38 2023-02-11 15:03:10,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=38, state=SUCCESS; CloseRegionProcedure c3f13a385e6198b8d8fd26b55fd70399, server=jenkins-hbase4.apache.org,36831,1676127776738 in 215 msec 2023-02-11 15:03:10,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c3f13a385e6198b8d8fd26b55fd70399, UNASSIGN in 275 msec 2023-02-11 15:03:10,549 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-11 15:03:10,549 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure df2de8d6db2cb3d0386ed041bdad062c, server=jenkins-hbase4.apache.org,34899,1676127776785 in 211 msec 2023-02-11 15:03:10,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=df2de8d6db2cb3d0386ed041bdad062c, UNASSIGN in 278 msec 2023-02-11 15:03:10,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366. 2023-02-11 15:03:10,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 469d3054dd21983cfad82fb29e410366: Waiting for close lock at 1676127790539Running coprocessor pre-close hooks at 1676127790539Disabling compacts and flushes for region at 1676127790539Disabling writes for close at 1676127790539Writing region close event to WAL at 1676127790542 (+3 ms)Running coprocessor post-close hooks at 1676127790548 (+6 ms)Closed at 1676127790558 (+10 ms) 2023-02-11 15:03:10,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 15:03:10,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531. 2023-02-11 15:03:10,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 806043054b417df07e85f9a4c0591531: Waiting for close lock at 1676127790544Running coprocessor pre-close hooks at 1676127790544Disabling compacts and flushes for region at 1676127790544Disabling writes for close at 1676127790544Writing region close event to WAL at 1676127790544Running coprocessor post-close hooks at 1676127790559 (+15 ms)Closed at 1676127790560 (+1 ms) 2023-02-11 15:03:10,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:10,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:10,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7503a4fa390b8a04141ec816adc41c0e, disabling compactions & flushes 2023-02-11 15:03:10,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:10,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:10,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. after waiting 0 ms 2023-02-11 15:03:10,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:10,561 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=469d3054dd21983cfad82fb29e410366, regionState=CLOSED 2023-02-11 15:03:10,561 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676127780829.469d3054dd21983cfad82fb29e410366.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790561"}]},"ts":"1676127790561"} 2023-02-11 15:03:10,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 806043054b417df07e85f9a4c0591531 2023-02-11 15:03:10,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:10,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=806043054b417df07e85f9a4c0591531, regionState=CLOSED 2023-02-11 15:03:10,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127790563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790563"}]},"ts":"1676127790563"} 2023-02-11 15:03:10,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff12effb8ed95b33aa54963a1f518e5b, disabling compactions & flushes 2023-02-11 15:03:10,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:10,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:10,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. after waiting 0 ms 2023-02-11 15:03:10,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:10,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-11 15:03:10,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 469d3054dd21983cfad82fb29e410366, server=jenkins-hbase4.apache.org,36831,1676127776738 in 230 msec 2023-02-11 15:03:10,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-11 15:03:10,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=469d3054dd21983cfad82fb29e410366, UNASSIGN in 296 msec 2023-02-11 15:03:10,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 806043054b417df07e85f9a4c0591531, server=jenkins-hbase4.apache.org,34899,1676127776785 in 228 msec 2023-02-11 15:03:10,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=806043054b417df07e85f9a4c0591531, UNASSIGN in 297 msec 2023-02-11 15:03:10,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:10,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 15:03:10,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e. 2023-02-11 15:03:10,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7503a4fa390b8a04141ec816adc41c0e: Waiting for close lock at 1676127790561Running coprocessor pre-close hooks at 1676127790561Disabling compacts and flushes for region at 1676127790561Disabling writes for close at 1676127790561Writing region close event to WAL at 1676127790562 (+1 ms)Running coprocessor post-close hooks at 1676127790574 (+12 ms)Closed at 1676127790575 (+1 ms) 2023-02-11 15:03:10,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:10,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7503a4fa390b8a04141ec816adc41c0e, regionState=CLOSED 2023-02-11 15:03:10,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127790578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790578"}]},"ts":"1676127790578"} 2023-02-11 15:03:10,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:10,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b. 2023-02-11 15:03:10,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff12effb8ed95b33aa54963a1f518e5b: Waiting for close lock at 1676127790564Running coprocessor pre-close hooks at 1676127790564Disabling compacts and flushes for region at 1676127790564Disabling writes for close at 1676127790564Writing region close event to WAL at 1676127790576 (+12 ms)Running coprocessor post-close hooks at 1676127790581 (+5 ms)Closed at 1676127790582 (+1 ms) 2023-02-11 15:03:10,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-11 15:03:10,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 7503a4fa390b8a04141ec816adc41c0e, server=jenkins-hbase4.apache.org,36831,1676127776738 in 276 msec 2023-02-11 15:03:10,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:10,585 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ff12effb8ed95b33aa54963a1f518e5b, regionState=CLOSED 2023-02-11 15:03:10,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7503a4fa390b8a04141ec816adc41c0e, UNASSIGN in 309 msec 2023-02-11 15:03:10,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127790585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127790585"}]},"ts":"1676127790585"} 2023-02-11 15:03:10,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=40 2023-02-11 15:03:10,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=40, state=SUCCESS; CloseRegionProcedure ff12effb8ed95b33aa54963a1f518e5b, server=jenkins-hbase4.apache.org,34899,1676127776785 in 267 msec 2023-02-11 15:03:10,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-11 15:03:10,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ff12effb8ed95b33aa54963a1f518e5b, UNASSIGN in 317 msec 2023-02-11 15:03:10,591 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127790591"}]},"ts":"1676127790591"} 2023-02-11 15:03:10,592 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-11 15:03:10,594 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-11 15:03:10,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 341 msec 2023-02-11 15:03:10,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:10,874 INFO [Listener at localhost/36917] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-11 15:03:10,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-11 15:03:10,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:10,888 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:10,891 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:10,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 15:03:10,907 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 2023-02-11 15:03:10,907 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:10,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:10,908 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:10,908 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:10,908 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:10,908 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:10,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:10,943 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/recovered.edits] 2023-02-11 15:03:10,944 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/recovered.edits] 2023-02-11 15:03:10,944 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/recovered.edits] 2023-02-11 15:03:10,945 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/recovered.edits] 2023-02-11 15:03:10,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/recovered.edits] 2023-02-11 15:03:10,946 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/recovered.edits] 2023-02-11 15:03:10,946 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/recovered.edits] 2023-02-11 15:03:10,946 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/recovered.edits] 2023-02-11 15:03:10,964 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/933863e9d0824b0588ddc54fda6156ac to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/933863e9d0824b0588ddc54fda6156ac 2023-02-11 15:03:10,964 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/0051aefd765b42838cc9b615402d4678 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/0051aefd765b42838cc9b615402d4678 2023-02-11 15:03:10,965 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/27be82f3a5a7448d819cc4583d35841a to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/27be82f3a5a7448d819cc4583d35841a 2023-02-11 15:03:10,968 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/1aee6990168c4d249a5c8f77f392fe7b to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/1aee6990168c4d249a5c8f77f392fe7b 2023-02-11 15:03:10,968 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/e89f3dd7105e40aca13e0eaca455fe42 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/e89f3dd7105e40aca13e0eaca455fe42 2023-02-11 15:03:10,968 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/4f3cfc9485d6404aa62d2b710177b48f to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/4f3cfc9485d6404aa62d2b710177b48f 2023-02-11 15:03:10,968 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/2c582d4f81f644a2a8f1db7a98ece9f3 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/2c582d4f81f644a2a8f1db7a98ece9f3 2023-02-11 15:03:10,969 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/recovered.edits/6.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531/recovered.edits/6.seqid 2023-02-11 15:03:10,970 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/c5a69dd1340147e0a2322ae24104ec6d to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f1/c5a69dd1340147e0a2322ae24104ec6d 2023-02-11 15:03:10,970 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/ef2014e17c9648e28c23bea812c97056 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f1/ef2014e17c9648e28c23bea812c97056 2023-02-11 15:03:10,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/806043054b417df07e85f9a4c0591531 2023-02-11 15:03:10,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:10,971 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/07995829ff034b4aa2d4011d3cdbf7ea to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f1/07995829ff034b4aa2d4011d3cdbf7ea 2023-02-11 15:03:10,972 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/f1dda6636892406588d5dcd50097ba75 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f1/f1dda6636892406588d5dcd50097ba75 2023-02-11 15:03:10,973 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/edc8b439e1d94f059daab7027009bf3b to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f1/edc8b439e1d94f059daab7027009bf3b 2023-02-11 15:03:10,973 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/bdb9839081134623bec2ce0ebd660157 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f1/bdb9839081134623bec2ce0ebd660157 2023-02-11 15:03:10,974 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/53be20c7e22f467cb05b06e428c40347 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f1/53be20c7e22f467cb05b06e428c40347 2023-02-11 15:03:10,980 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/recovered.edits] 2023-02-11 15:03:10,985 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/3b2a3217d8224f0daf3ef9bf17721386 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/3b2a3217d8224f0daf3ef9bf17721386 2023-02-11 15:03:10,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/15ec229bd1de4ceaa7dde1e7ac43e151 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/15ec229bd1de4ceaa7dde1e7ac43e151 2023-02-11 15:03:10,987 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/8bb404f219024d5aaf0bef51cc0374fb to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/8bb404f219024d5aaf0bef51cc0374fb 2023-02-11 15:03:10,989 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/93c4071c8f464336ae4d42216f0a21e9 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/93c4071c8f464336ae4d42216f0a21e9 2023-02-11 15:03:10,989 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/5fcac02cc6fd429fbd559fd9cda17fb4 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/5fcac02cc6fd429fbd559fd9cda17fb4 2023-02-11 15:03:10,990 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/3c9b6a6173044400a55908f905477804 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/3c9b6a6173044400a55908f905477804 2023-02-11 15:03:10,990 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/4b9e2de671594109b6135bf80ce39ad1 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/4b9e2de671594109b6135bf80ce39ad1 2023-02-11 15:03:10,992 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/a975b2496198407994aa9f76fa27314d to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/f2/a975b2496198407994aa9f76fa27314d 2023-02-11 15:03:10,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 15:03:10,993 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/ac6d70bc038e46ad9b964fbb77c6143a to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/f2/ac6d70bc038e46ad9b964fbb77c6143a 2023-02-11 15:03:10,994 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/5fa1eb130a584679b60936947da3714c to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/f2/5fa1eb130a584679b60936947da3714c 2023-02-11 15:03:10,995 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/f038fdc956464164ad0d0ee35b91cfce to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/f2/f038fdc956464164ad0d0ee35b91cfce 2023-02-11 15:03:10,995 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/dd445a21de0548a99b0d6313b6761684 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/f2/dd445a21de0548a99b0d6313b6761684 2023-02-11 15:03:10,997 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/bbd97761ef6b4fb5bf63061b41063998 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/f2/bbd97761ef6b4fb5bf63061b41063998 2023-02-11 15:03:11,000 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/fa6cffdc56524c7ba3ea4c24e38e6e71 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/f2/fa6cffdc56524c7ba3ea4c24e38e6e71 2023-02-11 15:03:11,000 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/b39657b5e3d545b6bc82e94062268d8a to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/b39657b5e3d545b6bc82e94062268d8a 2023-02-11 15:03:11,005 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399/recovered.edits/12.seqid 2023-02-11 15:03:11,006 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366/recovered.edits/12.seqid 2023-02-11 15:03:11,006 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/cebb80ddbfc4480aab7ae14497f7e8c7 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f1/cebb80ddbfc4480aab7ae14497f7e8c7 2023-02-11 15:03:11,007 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/c3f13a385e6198b8d8fd26b55fd70399 2023-02-11 15:03:11,007 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:11,008 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4/recovered.edits/12.seqid 2023-02-11 15:03:11,009 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/469d3054dd21983cfad82fb29e410366 2023-02-11 15:03:11,009 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465/recovered.edits/12.seqid 2023-02-11 15:03:11,009 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52/recovered.edits/12.seqid 2023-02-11 15:03:11,009 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b/recovered.edits/12.seqid 2023-02-11 15:03:11,010 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/d07bc8a765b8863b21b3930145a3dca4 2023-02-11 15:03:11,010 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/f6737ecdfb37bb096214e8d49d370465 2023-02-11 15:03:11,010 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/8e703d5836b126f747f8c19fd1af0a52 2023-02-11 15:03:11,012 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c/recovered.edits/12.seqid 2023-02-11 15:03:11,012 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/ff12effb8ed95b33aa54963a1f518e5b 2023-02-11 15:03:11,013 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/df2de8d6db2cb3d0386ed041bdad062c 2023-02-11 15:03:11,013 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f1, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/f2, FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/recovered.edits] 2023-02-11 15:03:11,015 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/65ba9a2a9ea7413faf9e7a92a239c742 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/65ba9a2a9ea7413faf9e7a92a239c742 2023-02-11 15:03:11,017 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/e37477063fb24da3bdfb4d7ded9eeff1 to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/f2/e37477063fb24da3bdfb4d7ded9eeff1 2023-02-11 15:03:11,022 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/recovered.edits/12.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0/recovered.edits/12.seqid 2023-02-11 15:03:11,023 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/recovered.edits/6.seqid to hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/archive/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e/recovered.edits/6.seqid 2023-02-11 15:03:11,023 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/08e5a362688ef0542fddc405a6c467b0 2023-02-11 15:03:11,024 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/.tmp/data/default/testWithMapReduce/7503a4fa390b8a04141ec816adc41c0e 2023-02-11 15:03:11,024 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 15:03:11,033 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:11,063 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-11 15:03:11,068 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-11 15:03:11,069 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:11,069 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676127780829.469d3054dd21983cfad82fb29e410366.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,070 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127791070"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,073 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-11 15:03:11,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 806043054b417df07e85f9a4c0591531, NAME => 'testWithMapReduce,,1676127780829.806043054b417df07e85f9a4c0591531.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => df2de8d6db2cb3d0386ed041bdad062c, NAME => 'testWithMapReduce,aaa,1676127780829.df2de8d6db2cb3d0386ed041bdad062c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 469d3054dd21983cfad82fb29e410366, NAME => 'testWithMapReduce,d\x84\x84,1676127780829.469d3054dd21983cfad82fb29e410366.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => f6737ecdfb37bb096214e8d49d370465, NAME => 'testWithMapReduce,g\xA7\xA7,1676127780829.f6737ecdfb37bb096214e8d49d370465.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => c3f13a385e6198b8d8fd26b55fd70399, NAME => 'testWithMapReduce,j\xCA\xCA,1676127780829.c3f13a385e6198b8d8fd26b55fd70399.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 8e703d5836b126f747f8c19fd1af0a52, NAME => 'testWithMapReduce,m\xED\xED,1676127780829.8e703d5836b126f747f8c19fd1af0a52.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => ff12effb8ed95b33aa54963a1f518e5b, NAME => 'testWithMapReduce,q\x11\x10,1676127780829.ff12effb8ed95b33aa54963a1f518e5b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => d07bc8a765b8863b21b3930145a3dca4, NAME => 'testWithMapReduce,t43,1676127780829.d07bc8a765b8863b21b3930145a3dca4.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 08e5a362688ef0542fddc405a6c467b0, NAME => 'testWithMapReduce,wWV,1676127780829.08e5a362688ef0542fddc405a6c467b0.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 7503a4fa390b8a04141ec816adc41c0e, NAME => 'testWithMapReduce,zz{,1676127780829.7503a4fa390b8a04141ec816adc41c0e.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-11 15:03:11,074 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-11 15:03:11,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676127791074"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:11,076 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-11 15:03:11,079 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:11,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 199 msec 2023-02-11 15:03:11,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43623] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 15:03:11,195 INFO [Listener at localhost/36917] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-11 15:03:11,196 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:11,196 INFO [Listener at localhost/36917] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:11,196 DEBUG [Listener at localhost/36917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5258bbcc to 127.0.0.1:57701 2023-02-11 15:03:11,196 DEBUG [Listener at localhost/36917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,196 DEBUG [Listener at localhost/36917] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:11,197 DEBUG [Listener at localhost/36917] util.JVMClusterUtil(257): Found active master hash=602479749, stopped=false 2023-02-11 15:03:11,197 INFO [Listener at localhost/36917] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:03:11,200 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:11,202 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:11,202 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:11,204 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:11,204 INFO [Listener at localhost/36917] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:11,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:11,204 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:11,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:11,206 DEBUG [Listener at localhost/36917] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62ce53fb to 127.0.0.1:57701 2023-02-11 15:03:11,206 DEBUG [Listener at localhost/36917] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,206 INFO [Listener at localhost/36917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36831,1676127776738' ***** 2023-02-11 15:03:11,206 INFO [Listener at localhost/36917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:11,206 INFO [Listener at localhost/36917] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34899,1676127776785' ***** 2023-02-11 15:03:11,206 INFO [Listener at localhost/36917] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:11,206 INFO [RS:1;jenkins-hbase4:34899] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:11,206 INFO [RS:0;jenkins-hbase4:36831] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:11,207 INFO [RS:0;jenkins-hbase4:36831] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:11,207 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:11,207 INFO [RS:0;jenkins-hbase4:36831] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:11,208 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(3304): Received CLOSE for 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:11,207 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:11,207 INFO [RS:1;jenkins-hbase4:34899] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:11,208 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:11,208 INFO [RS:1;jenkins-hbase4:34899] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:11,209 DEBUG [RS:0;jenkins-hbase4:36831] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bafa448 to 127.0.0.1:57701 2023-02-11 15:03:11,209 DEBUG [RS:0;jenkins-hbase4:36831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,210 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:11,210 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1479): Online Regions={136c216c51fb97c22efe5284b618a2f7=hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7.} 2023-02-11 15:03:11,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 136c216c51fb97c22efe5284b618a2f7, disabling compactions & flushes 2023-02-11 15:03:11,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:11,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:11,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. after waiting 0 ms 2023-02-11 15:03:11,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:11,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 136c216c51fb97c22efe5284b618a2f7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:11,211 DEBUG [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1505): Waiting on 136c216c51fb97c22efe5284b618a2f7 2023-02-11 15:03:11,209 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:11,212 DEBUG [RS:1;jenkins-hbase4:34899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b1003fc to 127.0.0.1:57701 2023-02-11 15:03:11,212 DEBUG [RS:1;jenkins-hbase4:34899] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,212 INFO [RS:1;jenkins-hbase4:34899] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:11,212 INFO [RS:1;jenkins-hbase4:34899] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:11,212 INFO [RS:1;jenkins-hbase4:34899] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:11,212 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:11,212 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:11,212 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 15:03:11,212 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:11,213 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:11,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:11,213 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:11,213 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:11,213 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:11,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-11 15:03:11,236 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:11,236 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:11,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/.tmp/info/bec5038c1c5c4d9ea4eb47d543170e30 2023-02-11 15:03:11,296 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/.tmp/info/ef2296f024bd4919a2d10521f5a654e7 2023-02-11 15:03:11,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef2296f024bd4919a2d10521f5a654e7 2023-02-11 15:03:11,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/.tmp/info/bec5038c1c5c4d9ea4eb47d543170e30 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/info/bec5038c1c5c4d9ea4eb47d543170e30 2023-02-11 15:03:11,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/info/bec5038c1c5c4d9ea4eb47d543170e30, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:11,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 136c216c51fb97c22efe5284b618a2f7 in 110ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:11,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/.tmp/rep_barrier/694a62f753b6474ebd9a8e4bc9f82cd6 2023-02-11 15:03:11,343 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 694a62f753b6474ebd9a8e4bc9f82cd6 2023-02-11 15:03:11,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/namespace/136c216c51fb97c22efe5284b618a2f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:11,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:11,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 136c216c51fb97c22efe5284b618a2f7: Waiting for close lock at 1676127791209Running coprocessor pre-close hooks at 1676127791209Disabling compacts and flushes for region at 1676127791209Disabling writes for close at 1676127791211 (+2 ms)Obtaining lock to block concurrent updates at 1676127791211Preparing flush snapshotting stores in 136c216c51fb97c22efe5284b618a2f7 at 1676127791211Finished memstore snapshotting hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127791211Flushing stores of hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. at 1676127791212 (+1 ms)Flushing 136c216c51fb97c22efe5284b618a2f7/info: creating writer at 1676127791212Flushing 136c216c51fb97c22efe5284b618a2f7/info: appending metadata at 1676127791216 (+4 ms)Flushing 136c216c51fb97c22efe5284b618a2f7/info: closing flushed file at 1676127791216Flushing 136c216c51fb97c22efe5284b618a2f7/info: reopening flushed file at 1676127791306 (+90 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 136c216c51fb97c22efe5284b618a2f7 in 110ms, sequenceid=6, compaction requested=false at 1676127791321 (+15 ms)Writing region close event to WAL at 1676127791344 (+23 ms)Running coprocessor post-close hooks at 1676127791349 (+5 ms)Closed at 1676127791350 (+1 ms) 2023-02-11 15:03:11,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127779828.136c216c51fb97c22efe5284b618a2f7. 2023-02-11 15:03:11,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/.tmp/table/63936057932f48cc932483326aabffdb 2023-02-11 15:03:11,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63936057932f48cc932483326aabffdb 2023-02-11 15:03:11,377 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/.tmp/info/ef2296f024bd4919a2d10521f5a654e7 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/info/ef2296f024bd4919a2d10521f5a654e7 2023-02-11 15:03:11,383 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ef2296f024bd4919a2d10521f5a654e7 2023-02-11 15:03:11,383 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/info/ef2296f024bd4919a2d10521f5a654e7, entries=30, sequenceid=57, filesize=7.9 K 2023-02-11 15:03:11,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/.tmp/rep_barrier/694a62f753b6474ebd9a8e4bc9f82cd6 as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/rep_barrier/694a62f753b6474ebd9a8e4bc9f82cd6 2023-02-11 15:03:11,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 694a62f753b6474ebd9a8e4bc9f82cd6 2023-02-11 15:03:11,390 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/rep_barrier/694a62f753b6474ebd9a8e4bc9f82cd6, entries=10, sequenceid=57, filesize=5.9 K 2023-02-11 15:03:11,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/.tmp/table/63936057932f48cc932483326aabffdb as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/table/63936057932f48cc932483326aabffdb 2023-02-11 15:03:11,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63936057932f48cc932483326aabffdb 2023-02-11 15:03:11,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/table/63936057932f48cc932483326aabffdb, entries=13, sequenceid=57, filesize=5.9 K 2023-02-11 15:03:11,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 185ms, sequenceid=57, compaction requested=false 2023-02-11 15:03:11,411 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36831,1676127776738; all regions closed. 2023-02-11 15:03:11,413 DEBUG [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:11,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-11 15:03:11,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:11,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:11,426 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127791212Running coprocessor pre-close hooks at 1676127791212Disabling compacts and flushes for region at 1676127791212Disabling writes for close at 1676127791213 (+1 ms)Obtaining lock to block concurrent updates at 1676127791213Preparing flush snapshotting stores in 1588230740 at 1676127791213Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676127791213Flushing stores of hbase:meta,,1.1588230740 at 1676127791214 (+1 ms)Flushing 1588230740/info: creating writer at 1676127791214Flushing 1588230740/info: appending metadata at 1676127791242 (+28 ms)Flushing 1588230740/info: closing flushed file at 1676127791242Flushing 1588230740/rep_barrier: creating writer at 1676127791305 (+63 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676127791308 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676127791308Flushing 1588230740/table: creating writer at 1676127791343 (+35 ms)Flushing 1588230740/table: appending metadata at 1676127791348 (+5 ms)Flushing 1588230740/table: closing flushed file at 1676127791349 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1676127791378 (+29 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676127791385 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676127791392 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 185ms, sequenceid=57, compaction requested=false at 1676127791398 (+6 ms)Writing region close event to WAL at 1676127791419 (+21 ms)Running coprocessor post-close hooks at 1676127791425 (+6 ms)Closed at 1676127791426 (+1 ms) 2023-02-11 15:03:11,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:11,428 DEBUG [RS:0;jenkins-hbase4:36831] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/oldWALs 2023-02-11 15:03:11,428 INFO [RS:0;jenkins-hbase4:36831] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36831%2C1676127776738:(num 1676127780195) 2023-02-11 15:03:11,428 DEBUG [RS:0;jenkins-hbase4:36831] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,428 INFO [RS:0;jenkins-hbase4:36831] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:11,428 INFO [RS:0;jenkins-hbase4:36831] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:11,428 INFO [RS:0;jenkins-hbase4:36831] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:11,429 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:11,429 INFO [RS:0;jenkins-hbase4:36831] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:11,429 INFO [RS:0;jenkins-hbase4:36831] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:11,430 INFO [RS:0;jenkins-hbase4:36831] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36831 2023-02-11 15:03:11,437 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:11,437 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:11,437 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36831,1676127776738 2023-02-11 15:03:11,437 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:11,437 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:11,438 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e8789f2 rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,440 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36831,1676127776738] 2023-02-11 15:03:11,440 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36831,1676127776738; numProcessing=1 2023-02-11 15:03:11,441 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36831,1676127776738 already deleted, retry=false 2023-02-11 15:03:11,441 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36831,1676127776738 expired; onlineServers=1 2023-02-11 15:03:11,613 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34899,1676127776785; all regions closed. 2023-02-11 15:03:11,619 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/WALs/jenkins-hbase4.apache.org,34899,1676127776785/jenkins-hbase4.apache.org%2C34899%2C1676127776785.meta.1676127779506.meta not finished, retry = 0 2023-02-11 15:03:11,703 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:11,703 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c456197 rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,703 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:36831-0x10043e811830001, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:11,703 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@340a1505 rejected from java.util.concurrent.ThreadPoolExecutor@2ab818fa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,703 INFO [RS:0;jenkins-hbase4:36831] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36831,1676127776738; zookeeper connection closed. 2023-02-11 15:03:11,704 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b809406] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b809406 2023-02-11 15:03:11,723 DEBUG [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/oldWALs 2023-02-11 15:03:11,723 INFO [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34899%2C1676127776785.meta:.meta(num 1676127779506) 2023-02-11 15:03:11,730 DEBUG [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/oldWALs 2023-02-11 15:03:11,730 INFO [RS:1;jenkins-hbase4:34899] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34899%2C1676127776785:(num 1676127780195) 2023-02-11 15:03:11,731 DEBUG [RS:1;jenkins-hbase4:34899] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,731 INFO [RS:1;jenkins-hbase4:34899] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:11,731 INFO [RS:1;jenkins-hbase4:34899] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:11,732 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:11,732 INFO [RS:1;jenkins-hbase4:34899] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34899 2023-02-11 15:03:11,735 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:11,735 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34899,1676127776785 2023-02-11 15:03:11,735 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@deb0f5c rejected from java.util.concurrent.ThreadPoolExecutor@9d49a39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,736 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34899,1676127776785] 2023-02-11 15:03:11,736 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34899,1676127776785; numProcessing=2 2023-02-11 15:03:11,739 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34899,1676127776785 already deleted, retry=false 2023-02-11 15:03:11,739 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34899,1676127776785 expired; onlineServers=0 2023-02-11 15:03:11,739 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43623,1676127775535' ***** 2023-02-11 15:03:11,739 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:11,739 DEBUG [M:0;jenkins-hbase4:43623] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62d416be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:11,740 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43623,1676127775535 2023-02-11 15:03:11,740 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43623,1676127775535; all regions closed. 2023-02-11 15:03:11,740 DEBUG [M:0;jenkins-hbase4:43623] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:11,740 DEBUG [M:0;jenkins-hbase4:43623] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:11,740 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127778005] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127778005,5,FailOnTimeoutGroup] 2023-02-11 15:03:11,740 DEBUG [M:0;jenkins-hbase4:43623] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127778009] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127778009,5,FailOnTimeoutGroup] 2023-02-11 15:03:11,742 INFO [M:0;jenkins-hbase4:43623] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:11,742 INFO [M:0;jenkins-hbase4:43623] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:11,742 INFO [M:0;jenkins-hbase4:43623] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:11,742 DEBUG [M:0;jenkins-hbase4:43623] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:11,742 INFO [M:0;jenkins-hbase4:43623] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:11,743 ERROR [M:0;jenkins-hbase4:43623] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-11 15:03:11,743 INFO [M:0;jenkins-hbase4:43623] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:11,744 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:11,745 DEBUG [M:0;jenkins-hbase4:43623] zookeeper.ZKUtil(398): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:11,745 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:11,745 WARN [M:0;jenkins-hbase4:43623] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:11,745 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:11,745 INFO [M:0;jenkins-hbase4:43623] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:11,746 INFO [M:0;jenkins-hbase4:43623] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:11,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:11,746 DEBUG [M:0;jenkins-hbase4:43623] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:11,746 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:11,746 DEBUG [M:0;jenkins-hbase4:43623] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:11,746 DEBUG [M:0;jenkins-hbase4:43623] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:11,746 DEBUG [M:0;jenkins-hbase4:43623] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:11,746 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.26 KB heapSize=192.19 KB 2023-02-11 15:03:11,772 INFO [M:0;jenkins-hbase4:43623] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.26 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7761fdc3961c45ce9bdff33be04ce64f 2023-02-11 15:03:11,778 DEBUG [M:0;jenkins-hbase4:43623] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7761fdc3961c45ce9bdff33be04ce64f as hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7761fdc3961c45ce9bdff33be04ce64f 2023-02-11 15:03:11,784 INFO [M:0;jenkins-hbase4:43623] regionserver.HStore(1080): Added hdfs://localhost:44609/user/jenkins/test-data/89b07cec-9603-5337-a734-95b6246e3923/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7761fdc3961c45ce9bdff33be04ce64f, entries=53, sequenceid=357, filesize=10.4 K 2023-02-11 15:03:11,786 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegion(2947): Finished flush of dataSize ~159.26 KB/163086, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 39ms, sequenceid=357, compaction requested=false 2023-02-11 15:03:11,793 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:11,793 DEBUG [M:0;jenkins-hbase4:43623] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127791746Disabling compacts and flushes for region at 1676127791746Disabling writes for close at 1676127791746Obtaining lock to block concurrent updates at 1676127791746Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127791746Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163086, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1676127791747 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127791748 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127791748Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127791753 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127791753Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127791779 (+26 ms)Finished flush of dataSize ~159.26 KB/163086, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 39ms, sequenceid=357, compaction requested=false at 1676127791786 (+7 ms)Writing region close event to WAL at 1676127791793 (+7 ms)Closed at 1676127791793 2023-02-11 15:03:11,798 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:11,798 INFO [M:0;jenkins-hbase4:43623] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:11,798 INFO [M:0;jenkins-hbase4:43623] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43623 2023-02-11 15:03:11,801 DEBUG [M:0;jenkins-hbase4:43623] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43623,1676127775535 already deleted, retry=false 2023-02-11 15:03:11,836 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:11,836 INFO [RS:1;jenkins-hbase4:34899] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34899,1676127776785; zookeeper connection closed. 2023-02-11 15:03:11,836 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2814030d rejected from java.util.concurrent.ThreadPoolExecutor@9d49a39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,837 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f610591] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f610591 2023-02-11 15:03:11,837 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): regionserver:34899-0x10043e811830002, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:11,837 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5078307d rejected from java.util.concurrent.ThreadPoolExecutor@9d49a39[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,837 INFO [Listener at localhost/36917] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:11,936 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:11,936 INFO [M:0;jenkins-hbase4:43623] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43623,1676127775535; zookeeper connection closed. 2023-02-11 15:03:11,937 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7e059bb rejected from java.util.concurrent.ThreadPoolExecutor@41ca260[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,937 DEBUG [Listener at localhost/36917-EventThread] zookeeper.ZKWatcher(600): master:43623-0x10043e811830000, quorum=127.0.0.1:57701, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:11,937 ERROR [Listener at localhost/36917-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7bdec807 rejected from java.util.concurrent.ThreadPoolExecutor@41ca260[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:11,939 WARN [Listener at localhost/36917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:11,954 INFO [Listener at localhost/36917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:12,061 WARN [BP-1282330029-172.31.14.131-1676127771880 heartbeating to localhost/127.0.0.1:44609] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:12,061 WARN [BP-1282330029-172.31.14.131-1676127771880 heartbeating to localhost/127.0.0.1:44609] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1282330029-172.31.14.131-1676127771880 (Datanode Uuid e871af98-4b5f-4035-b2cc-fb1ac0e3ceb4) service to localhost/127.0.0.1:44609 2023-02-11 15:03:12,063 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/dfs/data/data3/current/BP-1282330029-172.31.14.131-1676127771880] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:12,063 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/dfs/data/data4/current/BP-1282330029-172.31.14.131-1676127771880] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:12,066 WARN [Listener at localhost/36917] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:12,073 INFO [Listener at localhost/36917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:12,177 WARN [BP-1282330029-172.31.14.131-1676127771880 heartbeating to localhost/127.0.0.1:44609] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:12,177 WARN [BP-1282330029-172.31.14.131-1676127771880 heartbeating to localhost/127.0.0.1:44609] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1282330029-172.31.14.131-1676127771880 (Datanode Uuid 494ab9df-7cdb-437b-9aa2-b113691cb7dd) service to localhost/127.0.0.1:44609 2023-02-11 15:03:12,178 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/dfs/data/data1/current/BP-1282330029-172.31.14.131-1676127771880] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:12,178 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/cluster_fcf67c2c-d967-cb5b-6f53-b6ce91e5dcc3/dfs/data/data2/current/BP-1282330029-172.31.14.131-1676127771880] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:12,226 INFO [Listener at localhost/36917] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:12,355 INFO [Listener at localhost/36917] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:12,443 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:12,465 INFO [Listener at localhost/36917] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=102 (was 7) Potentially hanging thread: (jenkins-hbase4.apache.org,43623,1676127775535)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:44609 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-3-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36917 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44609 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@5a24889f java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44609 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:44609 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44609 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-3-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 186) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4237 (was 5232) 2023-02-11 15:03:12,476 INFO [Listener at localhost/36917] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=102, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=169, AvailableMemoryMB=4237 2023-02-11 15:03:12,489 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop.log.dir so I do NOT create it in target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a 2023-02-11 15:03:12,489 WARN [Listener at localhost/36917] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 15:03:12,489 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop.tmp.dir so I do NOT create it in target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a 2023-02-11 15:03:12,489 WARN [Listener at localhost/36917] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cd2ce0f5-68dc-67e8-22a2-62feafcb45f2/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 15:03:12,489 DEBUG [Listener at localhost/36917] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7, deleteOnExit=true 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/test.cache.data in system properties and HBase conf 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:03:12,490 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:03:12,491 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:03:12,491 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:03:12,491 DEBUG [Listener at localhost/36917] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:03:12,491 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:12,491 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:12,491 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:03:12,492 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:03:12,493 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:12,493 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:03:12,493 INFO [Listener at localhost/36917] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:03:12,497 WARN [Listener at localhost/36917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:12,497 WARN [Listener at localhost/36917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:12,542 WARN [Listener at localhost/36917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:12,545 INFO [Listener at localhost/36917] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:12,552 INFO [Listener at localhost/36917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/java.io.tmpdir/Jetty_localhost_45185_hdfs____.7vyqo9/webapp 2023-02-11 15:03:12,671 INFO [Listener at localhost/36917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45185 2023-02-11 15:03:12,675 WARN [Listener at localhost/36917] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:12,676 WARN [Listener at localhost/36917] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:12,731 WARN [Listener at localhost/33135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:12,749 WARN [Listener at localhost/33135] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:12,752 WARN [Listener at localhost/33135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:12,753 INFO [Listener at localhost/33135] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:12,760 INFO [Listener at localhost/33135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/java.io.tmpdir/Jetty_localhost_39441_datanode____.nsrpxq/webapp 2023-02-11 15:03:12,866 INFO [Listener at localhost/33135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39441 2023-02-11 15:03:12,878 WARN [Listener at localhost/36553] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:12,892 WARN [Listener at localhost/36553] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:12,894 WARN [Listener at localhost/36553] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:12,895 INFO [Listener at localhost/36553] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:12,899 INFO [Listener at localhost/36553] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/java.io.tmpdir/Jetty_localhost_38911_datanode____.7o9chx/webapp 2023-02-11 15:03:13,007 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5eb6b33a7f42faf: Processing first storage report for DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742 from datanode 680f0b0c-2d89-4c51-8792-1043774aac2e 2023-02-11 15:03:13,008 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5eb6b33a7f42faf: from storage DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742 node DatanodeRegistration(127.0.0.1:33089, datanodeUuid=680f0b0c-2d89-4c51-8792-1043774aac2e, infoPort=43551, infoSecurePort=0, ipcPort=36553, storageInfo=lv=-57;cid=testClusterID;nsid=956249334;c=1676127792500), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:13,008 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5eb6b33a7f42faf: Processing first storage report for DS-51dc6837-0bf9-4aa9-a0ea-30a83e63f3ea from datanode 680f0b0c-2d89-4c51-8792-1043774aac2e 2023-02-11 15:03:13,008 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5eb6b33a7f42faf: from storage DS-51dc6837-0bf9-4aa9-a0ea-30a83e63f3ea node DatanodeRegistration(127.0.0.1:33089, datanodeUuid=680f0b0c-2d89-4c51-8792-1043774aac2e, infoPort=43551, infoSecurePort=0, ipcPort=36553, storageInfo=lv=-57;cid=testClusterID;nsid=956249334;c=1676127792500), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:13,020 INFO [Listener at localhost/36553] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38911 2023-02-11 15:03:13,029 WARN [Listener at localhost/33637] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:13,144 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7be6ac58b4f6ba06: Processing first storage report for DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e from datanode a271367d-f2f9-4c7e-8d84-669f656801b1 2023-02-11 15:03:13,144 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7be6ac58b4f6ba06: from storage DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e node DatanodeRegistration(127.0.0.1:46551, datanodeUuid=a271367d-f2f9-4c7e-8d84-669f656801b1, infoPort=39275, infoSecurePort=0, ipcPort=33637, storageInfo=lv=-57;cid=testClusterID;nsid=956249334;c=1676127792500), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:13,144 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7be6ac58b4f6ba06: Processing first storage report for DS-0eecd1a8-ffc7-4b5c-ac18-b3ff94789466 from datanode a271367d-f2f9-4c7e-8d84-669f656801b1 2023-02-11 15:03:13,144 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7be6ac58b4f6ba06: from storage DS-0eecd1a8-ffc7-4b5c-ac18-b3ff94789466 node DatanodeRegistration(127.0.0.1:46551, datanodeUuid=a271367d-f2f9-4c7e-8d84-669f656801b1, infoPort=39275, infoSecurePort=0, ipcPort=33637, storageInfo=lv=-57;cid=testClusterID;nsid=956249334;c=1676127792500), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:13,147 DEBUG [Listener at localhost/33637] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a 2023-02-11 15:03:13,153 INFO [Listener at localhost/33637] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/zookeeper_0, clientPort=64464, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:03:13,155 INFO [Listener at localhost/33637] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64464 2023-02-11 15:03:13,155 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,156 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,178 INFO [Listener at localhost/33637] util.FSUtils(479): Created version file at hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a with version=8 2023-02-11 15:03:13,178 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,179 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,181 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/hbase-staging 2023-02-11 15:03:13,183 INFO [Listener at localhost/33637] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:13,183 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,183 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,184 INFO [Listener at localhost/33637] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:13,184 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,184 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:13,184 INFO [Listener at localhost/33637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:13,193 INFO [Listener at localhost/33637] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41051 2023-02-11 15:03:13,194 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,195 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,196 INFO [Listener at localhost/33637] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41051 connecting to ZooKeeper ensemble=127.0.0.1:64464 2023-02-11 15:03:13,218 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:410510x0, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:13,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41051-0x10043e859c60000 connected 2023-02-11 15:03:13,246 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:13,247 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:13,247 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:13,252 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41051 2023-02-11 15:03:13,252 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41051 2023-02-11 15:03:13,256 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41051 2023-02-11 15:03:13,258 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41051 2023-02-11 15:03:13,260 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41051 2023-02-11 15:03:13,260 INFO [Listener at localhost/33637] master.HMaster(439): hbase.rootdir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a, hbase.cluster.distributed=false 2023-02-11 15:03:13,280 INFO [Listener at localhost/33637] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:13,280 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,281 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,281 INFO [Listener at localhost/33637] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:13,281 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,281 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:13,281 INFO [Listener at localhost/33637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:13,284 INFO [Listener at localhost/33637] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44339 2023-02-11 15:03:13,285 INFO [Listener at localhost/33637] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:13,286 DEBUG [Listener at localhost/33637] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:13,287 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,288 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,288 INFO [Listener at localhost/33637] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44339 connecting to ZooKeeper ensemble=127.0.0.1:64464 2023-02-11 15:03:13,292 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:443390x0, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:13,293 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): regionserver:443390x0, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:13,293 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): regionserver:443390x0, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:13,294 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): regionserver:443390x0, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:13,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44339-0x10043e859c60001 connected 2023-02-11 15:03:13,296 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44339 2023-02-11 15:03:13,297 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44339 2023-02-11 15:03:13,299 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44339 2023-02-11 15:03:13,303 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44339 2023-02-11 15:03:13,304 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44339 2023-02-11 15:03:13,318 INFO [Listener at localhost/33637] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:13,319 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,319 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,319 INFO [Listener at localhost/33637] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:13,319 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:13,319 INFO [Listener at localhost/33637] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:13,319 INFO [Listener at localhost/33637] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:13,321 INFO [Listener at localhost/33637] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46503 2023-02-11 15:03:13,322 INFO [Listener at localhost/33637] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:13,323 DEBUG [Listener at localhost/33637] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:13,324 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,325 INFO [Listener at localhost/33637] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,326 INFO [Listener at localhost/33637] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46503 connecting to ZooKeeper ensemble=127.0.0.1:64464 2023-02-11 15:03:13,330 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:465030x0, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:13,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46503-0x10043e859c60002 connected 2023-02-11 15:03:13,332 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:13,333 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:13,333 DEBUG [Listener at localhost/33637] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:13,337 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46503 2023-02-11 15:03:13,338 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46503 2023-02-11 15:03:13,340 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46503 2023-02-11 15:03:13,343 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46503 2023-02-11 15:03:13,343 DEBUG [Listener at localhost/33637] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46503 2023-02-11 15:03:13,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,346 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:13,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,349 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:13,349 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,349 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:13,349 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:13,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:13,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:13,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41051,1676127793183 from backup master directory 2023-02-11 15:03:13,353 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,353 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:13,353 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:13,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/hbase.id with ID: a9acc5ab-f2cb-4fd1-b20b-88820bb0adaf 2023-02-11 15:03:13,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:13,393 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4ec0ae87 to 127.0.0.1:64464 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:13,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73dd349, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:13,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:13,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:03:13,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:13,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store-tmp 2023-02-11 15:03:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:13,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:13,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:13,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127793444Disabling compacts and flushes for region at 1676127793444Disabling writes for close at 1676127793444Writing region close event to WAL at 1676127793444Closed at 1676127793444 2023-02-11 15:03:13,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/WALs/jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41051%2C1676127793183, suffix=, logDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/WALs/jenkins-hbase4.apache.org,41051,1676127793183, archiveDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/oldWALs, maxLogs=10 2023-02-11 15:03:13,468 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK] 2023-02-11 15:03:13,470 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK] 2023-02-11 15:03:13,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/WALs/jenkins-hbase4.apache.org,41051,1676127793183/jenkins-hbase4.apache.org%2C41051%2C1676127793183.1676127793448 2023-02-11 15:03:13,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK], DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK]] 2023-02-11 15:03:13,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:13,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:13,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:13,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:13,478 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:13,479 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:03:13,480 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:03:13,480 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:13,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:13,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:13,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:13,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64230987, jitterRate=-0.04288370907306671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:13,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127793477Initializing all the Stores at 1676127793478 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127793478Cleaning up temporary data from old regions at 1676127793482 (+4 ms)Cleaning up detritus from prior splits at 1676127793483 (+1 ms)Region opened successfully at 1676127793489 (+6 ms) 2023-02-11 15:03:13,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:03:13,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:03:13,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:03:13,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:03:13,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 15:03:13,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 15:03:13,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:03:13,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:03:13,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:03:13,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:03:13,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:03:13,519 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:03:13,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:03:13,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:03:13,523 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:03:13,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:03:13,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:03:13,526 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:13,526 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:13,526 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:13,526 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41051,1676127793183, sessionid=0x10043e859c60000, setting cluster-up flag (Was=false) 2023-02-11 15:03:13,532 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:03:13,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,542 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:03:13,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:13,548 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.hbase-snapshot/.tmp 2023-02-11 15:03:13,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:13,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,562 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:13,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127823562 2023-02-11 15:03:13,562 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:03:13,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:03:13,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:03:13,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:03:13,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:03:13,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:03:13,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:03:13,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:03:13,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:03:13,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:03:13,564 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:13,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:03:13,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:03:13,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127793565,5,FailOnTimeoutGroup] 2023-02-11 15:03:13,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127793565,5,FailOnTimeoutGroup] 2023-02-11 15:03:13,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:03:13,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,580 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:13,581 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:13,581 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a 2023-02-11 15:03:13,592 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:13,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:13,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/info 2023-02-11 15:03:13,595 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:13,596 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,596 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:13,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:13,598 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:13,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:13,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/table 2023-02-11 15:03:13,600 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:13,601 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,601 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740 2023-02-11 15:03:13,602 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740 2023-02-11 15:03:13,604 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:13,605 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:13,607 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:13,608 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68308706, jitterRate=0.01787903904914856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:13,608 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127793592Initializing all the Stores at 1676127793593 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127793593Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127793593Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127793593Cleaning up temporary data from old regions at 1676127793603 (+10 ms)Cleaning up detritus from prior splits at 1676127793603Region opened successfully at 1676127793608 (+5 ms) 2023-02-11 15:03:13,608 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:13,608 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:13,608 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:13,608 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:13,608 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:13,608 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:13,608 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127793608Disabling compacts and flushes for region at 1676127793608Disabling writes for close at 1676127793608Writing region close event to WAL at 1676127793608Closed at 1676127793608 2023-02-11 15:03:13,609 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:13,609 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:03:13,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:03:13,611 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:03:13,613 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:03:13,646 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(952): ClusterId : a9acc5ab-f2cb-4fd1-b20b-88820bb0adaf 2023-02-11 15:03:13,646 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(952): ClusterId : a9acc5ab-f2cb-4fd1-b20b-88820bb0adaf 2023-02-11 15:03:13,646 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:13,646 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:13,654 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:13,655 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:13,654 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:13,655 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:13,657 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:13,657 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:13,658 DEBUG [RS:0;jenkins-hbase4:44339] zookeeper.ReadOnlyZKClient(139): Connect 0x7d1cca47 to 127.0.0.1:64464 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:13,659 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ReadOnlyZKClient(139): Connect 0x73b84a96 to 127.0.0.1:64464 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:13,665 DEBUG [RS:0;jenkins-hbase4:44339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73db3b94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:13,665 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d7faa91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:13,665 DEBUG [RS:0;jenkins-hbase4:44339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77e4a137, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:13,665 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@794021e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:13,676 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46503 2023-02-11 15:03:13,676 INFO [RS:1;jenkins-hbase4:46503] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:13,676 INFO [RS:1;jenkins-hbase4:46503] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:13,676 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:13,677 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41051,1676127793183 with isa=jenkins-hbase4.apache.org/172.31.14.131:46503, startcode=1676127793318 2023-02-11 15:03:13,677 DEBUG [RS:1;jenkins-hbase4:46503] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:13,680 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37371, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:13,680 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44339 2023-02-11 15:03:13,680 INFO [RS:0;jenkins-hbase4:44339] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:13,680 INFO [RS:0;jenkins-hbase4:44339] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:13,680 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:13,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,682 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41051,1676127793183 with isa=jenkins-hbase4.apache.org/172.31.14.131:44339, startcode=1676127793280 2023-02-11 15:03:13,682 DEBUG [RS:0;jenkins-hbase4:44339] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:13,682 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a 2023-02-11 15:03:13,682 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33135 2023-02-11 15:03:13,682 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:13,685 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:13,685 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ZKUtil(162): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,685 WARN [RS:1;jenkins-hbase4:46503] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:13,686 INFO [RS:1;jenkins-hbase4:46503] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:13,686 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,690 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46503,1676127793318] 2023-02-11 15:03:13,691 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53619, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:13,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,692 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a 2023-02-11 15:03:13,692 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33135 2023-02-11 15:03:13,692 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:13,697 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:13,697 DEBUG [RS:0;jenkins-hbase4:44339] zookeeper.ZKUtil(162): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,697 WARN [RS:0;jenkins-hbase4:44339] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:13,697 INFO [RS:0;jenkins-hbase4:44339] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:13,697 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,698 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44339,1676127793280] 2023-02-11 15:03:13,699 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ZKUtil(162): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,700 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ZKUtil(162): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,702 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:13,702 INFO [RS:1;jenkins-hbase4:46503] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:13,702 DEBUG [RS:0;jenkins-hbase4:44339] zookeeper.ZKUtil(162): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,702 DEBUG [RS:0;jenkins-hbase4:44339] zookeeper.ZKUtil(162): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,703 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:13,704 INFO [RS:0;jenkins-hbase4:44339] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:13,708 INFO [RS:1;jenkins-hbase4:46503] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:13,708 INFO [RS:0;jenkins-hbase4:44339] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:13,708 INFO [RS:1;jenkins-hbase4:46503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:13,708 INFO [RS:0;jenkins-hbase4:44339] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:13,708 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,709 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,712 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:13,713 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:13,714 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,714 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,714 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,714 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:13,715 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:13,715 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:0;jenkins-hbase4:44339] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,715 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:13,721 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,721 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,721 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,721 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,721 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,722 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,742 INFO [RS:0;jenkins-hbase4:44339] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:13,742 INFO [RS:1;jenkins-hbase4:46503] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:13,742 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44339,1676127793280-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,742 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46503,1676127793318-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:13,759 INFO [RS:1;jenkins-hbase4:46503] regionserver.Replication(203): jenkins-hbase4.apache.org,46503,1676127793318 started 2023-02-11 15:03:13,759 INFO [RS:0;jenkins-hbase4:44339] regionserver.Replication(203): jenkins-hbase4.apache.org,44339,1676127793280 started 2023-02-11 15:03:13,759 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46503,1676127793318, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46503, sessionid=0x10043e859c60002 2023-02-11 15:03:13,759 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44339,1676127793280, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44339, sessionid=0x10043e859c60001 2023-02-11 15:03:13,759 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:13,759 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:13,759 DEBUG [RS:0;jenkins-hbase4:44339] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,759 DEBUG [RS:1;jenkins-hbase4:46503] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,759 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46503,1676127793318' 2023-02-11 15:03:13,759 DEBUG [RS:0;jenkins-hbase4:44339] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44339,1676127793280' 2023-02-11 15:03:13,759 DEBUG [RS:0;jenkins-hbase4:44339] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:13,759 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:13,760 DEBUG [RS:0;jenkins-hbase4:44339] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:13,760 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:13,760 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:13,761 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:13,760 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:13,761 DEBUG [RS:1;jenkins-hbase4:46503] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:13,761 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46503,1676127793318' 2023-02-11 15:03:13,761 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:13,761 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:13,761 DEBUG [RS:0;jenkins-hbase4:44339] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,761 DEBUG [RS:0;jenkins-hbase4:44339] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44339,1676127793280' 2023-02-11 15:03:13,761 DEBUG [RS:0;jenkins-hbase4:44339] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:13,761 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:13,761 DEBUG [RS:0;jenkins-hbase4:44339] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:13,762 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:13,762 DEBUG [RS:0;jenkins-hbase4:44339] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:13,762 INFO [RS:1;jenkins-hbase4:46503] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:13,762 INFO [RS:1;jenkins-hbase4:46503] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:13,762 INFO [RS:0;jenkins-hbase4:44339] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:13,762 INFO [RS:0;jenkins-hbase4:44339] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:13,763 DEBUG [jenkins-hbase4:41051] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:03:13,763 DEBUG [jenkins-hbase4:41051] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:13,765 DEBUG [jenkins-hbase4:41051] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:13,765 DEBUG [jenkins-hbase4:41051] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:13,765 DEBUG [jenkins-hbase4:41051] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:13,766 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44339,1676127793280, state=OPENING 2023-02-11 15:03:13,768 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:03:13,770 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:13,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:13,770 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:13,925 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:13,925 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:13,928 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51064, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:13,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:03:13,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:13,934 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44339%2C1676127793280.meta, suffix=.meta, logDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,44339,1676127793280, archiveDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/oldWALs, maxLogs=32 2023-02-11 15:03:13,959 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK] 2023-02-11 15:03:13,959 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK] 2023-02-11 15:03:13,964 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,44339,1676127793280/jenkins-hbase4.apache.org%2C44339%2C1676127793280.meta.1676127793936.meta 2023-02-11 15:03:13,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK], DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK]] 2023-02-11 15:03:13,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:13,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:03:13,966 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:03:13,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:03:13,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:03:13,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:13,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:03:13,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:03:13,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:13,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/info 2023-02-11 15:03:13,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/info 2023-02-11 15:03:13,972 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:13,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,972 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:13,973 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:13,974 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:13,974 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:13,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,975 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:13,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/table 2023-02-11 15:03:13,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/table 2023-02-11 15:03:13,977 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:13,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:13,979 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740 2023-02-11 15:03:13,980 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740 2023-02-11 15:03:13,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:13,984 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:13,985 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75130253, jitterRate=0.11952801048755646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:13,985 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127793968Writing region info on filesystem at 1676127793968Initializing all the Stores at 1676127793969 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127793969Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127793970 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127793970Cleaning up temporary data from old regions at 1676127793981 (+11 ms)Cleaning up detritus from prior splits at 1676127793982 (+1 ms)Running coprocessor post-open hooks at 1676127793985 (+3 ms)Region opened successfully at 1676127793985 2023-02-11 15:03:13,986 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127793925 2023-02-11 15:03:13,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:03:13,992 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:03:13,992 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44339,1676127793280, state=OPEN 2023-02-11 15:03:13,994 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:03:13,994 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:13,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:03:13,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44339,1676127793280 in 224 msec 2023-02-11 15:03:13,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:03:13,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 387 msec 2023-02-11 15:03:14,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 449 msec 2023-02-11 15:03:14,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127793347, completionTime=-1 2023-02-11 15:03:14,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:03:14,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:03:14,003 DEBUG [hconnection-0x52c5a2fb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:14,009 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51074, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:14,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:03:14,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127854011 2023-02-11 15:03:14,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127914012 2023-02-11 15:03:14,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-11 15:03:14,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41051,1676127793183-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:14,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41051,1676127793183-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:14,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41051,1676127793183-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:14,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41051, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:14,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:14,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:03:14,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:14,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:03:14,023 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:03:14,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:14,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:14,026 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,027 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f empty. 2023-02-11 15:03:14,027 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,027 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:03:14,041 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:14,042 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a1945f32b23894b48d5dcdf95850924f, NAME => 'hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a1945f32b23894b48d5dcdf95850924f, disabling compactions & flushes 2023-02-11 15:03:14,055 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. after waiting 0 ms 2023-02-11 15:03:14,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,055 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,055 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a1945f32b23894b48d5dcdf95850924f: Waiting for close lock at 1676127794055Disabling compacts and flushes for region at 1676127794055Disabling writes for close at 1676127794055Writing region close event to WAL at 1676127794055Closed at 1676127794055 2023-02-11 15:03:14,058 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:14,059 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127794058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794058"}]},"ts":"1676127794058"} 2023-02-11 15:03:14,062 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:14,063 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:14,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127794063"}]},"ts":"1676127794063"} 2023-02-11 15:03:14,064 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:14,068 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:14,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:14,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:14,069 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:14,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a1945f32b23894b48d5dcdf95850924f, ASSIGN}] 2023-02-11 15:03:14,071 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a1945f32b23894b48d5dcdf95850924f, ASSIGN 2023-02-11 15:03:14,072 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a1945f32b23894b48d5dcdf95850924f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44339,1676127793280; forceNewPlan=false, retain=false 2023-02-11 15:03:14,223 INFO [jenkins-hbase4:41051] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:14,224 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a1945f32b23894b48d5dcdf95850924f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,224 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127794224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794224"}]},"ts":"1676127794224"} 2023-02-11 15:03:14,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a1945f32b23894b48d5dcdf95850924f, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:14,383 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44339%2C1676127793280, suffix=, logDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,44339,1676127793280, archiveDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/oldWALs, maxLogs=32 2023-02-11 15:03:14,405 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK] 2023-02-11 15:03:14,405 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK] 2023-02-11 15:03:14,407 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,44339,1676127793280/jenkins-hbase4.apache.org%2C44339%2C1676127793280.1676127794386 2023-02-11 15:03:14,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK], DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK]] 2023-02-11 15:03:14,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a1945f32b23894b48d5dcdf95850924f, NAME => 'hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:14,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,409 INFO [StoreOpener-a1945f32b23894b48d5dcdf95850924f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,410 DEBUG [StoreOpener-a1945f32b23894b48d5dcdf95850924f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/info 2023-02-11 15:03:14,410 DEBUG [StoreOpener-a1945f32b23894b48d5dcdf95850924f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/info 2023-02-11 15:03:14,411 INFO [StoreOpener-a1945f32b23894b48d5dcdf95850924f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1945f32b23894b48d5dcdf95850924f columnFamilyName info 2023-02-11 15:03:14,411 INFO [StoreOpener-a1945f32b23894b48d5dcdf95850924f-1] regionserver.HStore(310): Store=a1945f32b23894b48d5dcdf95850924f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:14,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,412 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:14,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:14,416 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a1945f32b23894b48d5dcdf95850924f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72604445, jitterRate=0.0818905383348465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:14,416 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a1945f32b23894b48d5dcdf95850924f: Running coprocessor pre-open hook at 1676127794408Writing region info on filesystem at 1676127794408Initializing all the Stores at 1676127794409 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127794409Cleaning up temporary data from old regions at 1676127794413 (+4 ms)Cleaning up detritus from prior splits at 1676127794413Running coprocessor post-open hooks at 1676127794416 (+3 ms)Region opened successfully at 1676127794416 2023-02-11 15:03:14,417 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f., pid=6, masterSystemTime=1676127794379 2023-02-11 15:03:14,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:14,420 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a1945f32b23894b48d5dcdf95850924f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,420 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127794420"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127794420"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127794420"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127794420"}]},"ts":"1676127794420"} 2023-02-11 15:03:14,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:14,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a1945f32b23894b48d5dcdf95850924f, server=jenkins-hbase4.apache.org,44339,1676127793280 in 196 msec 2023-02-11 15:03:14,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:14,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a1945f32b23894b48d5dcdf95850924f, ASSIGN in 355 msec 2023-02-11 15:03:14,427 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:14,428 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127794428"}]},"ts":"1676127794428"} 2023-02-11 15:03:14,429 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:14,432 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:14,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 411 msec 2023-02-11 15:03:14,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:14,525 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:14,525 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:14,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:14,539 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:14,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-11 15:03:14,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:14,559 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:14,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-11 15:03:14,567 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:14,569 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:14,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.215sec 2023-02-11 15:03:14,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:14,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:14,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:14,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41051,1676127793183-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:14,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41051,1676127793183-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:14,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:14,646 DEBUG [Listener at localhost/33637] zookeeper.ReadOnlyZKClient(139): Connect 0x7ecc4d24 to 127.0.0.1:64464 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:14,652 DEBUG [Listener at localhost/33637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521aec37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:14,654 DEBUG [hconnection-0x64ae4e2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:14,656 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:14,658 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:14,658 DEBUG [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:14,660 DEBUG [Listener at localhost/33637] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:14,663 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:14,664 INFO [Listener at localhost/33637] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 15:03:14,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 15:03:14,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:14,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:51266 deadline: 1676127854664, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 15:03:14,665 INFO [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 15:03:14,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:14,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 15:03:14,670 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:14,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 15:03:14,671 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:14,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:14,681 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24 empty. 2023-02-11 15:03:14,681 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f empty. 2023-02-11 15:03:14,681 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc empty. 2023-02-11 15:03:14,681 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5 empty. 2023-02-11 15:03:14,681 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615 empty. 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e empty. 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449 empty. 2023-02-11 15:03:14,683 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:14,680 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:14,682 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:14,684 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96 empty. 2023-02-11 15:03:14,684 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9 empty. 2023-02-11 15:03:14,684 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b empty. 2023-02-11 15:03:14,685 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:14,685 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:14,685 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:14,685 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 15:03:14,696 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:14,698 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4fd46c7a33b7ce6df81a694bff30024e, NAME => 'testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,698 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 734d9a680881f9d7559efd10e093fc24, NAME => 'testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,698 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f30072536f47d4a1465cf0f8579c3e7f, NAME => 'testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f30072536f47d4a1465cf0f8579c3e7f, disabling compactions & flushes 2023-02-11 15:03:14,711 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4fd46c7a33b7ce6df81a694bff30024e, disabling compactions & flushes 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. after waiting 0 ms 2023-02-11 15:03:14,711 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:14,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:14,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:14,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:14,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. after waiting 0 ms 2023-02-11 15:03:14,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f30072536f47d4a1465cf0f8579c3e7f: Waiting for close lock at 1676127794711Disabling compacts and flushes for region at 1676127794711Disabling writes for close at 1676127794711Writing region close event to WAL at 1676127794712 (+1 ms)Closed at 1676127794712 2023-02-11 15:03:14,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:14,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:14,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4fd46c7a33b7ce6df81a694bff30024e: Waiting for close lock at 1676127794711Disabling compacts and flushes for region at 1676127794711Disabling writes for close at 1676127794712 (+1 ms)Writing region close event to WAL at 1676127794712Closed at 1676127794712 2023-02-11 15:03:14,713 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ac89e902bd409aeb900a49780e6cd2f5, NAME => 'testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,713 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9ca200f280be5e80a4a0b8884c99d615, NAME => 'testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 734d9a680881f9d7559efd10e093fc24, disabling compactions & flushes 2023-02-11 15:03:14,713 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:14,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:14,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. after waiting 0 ms 2023-02-11 15:03:14,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:14,713 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:14,713 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 734d9a680881f9d7559efd10e093fc24: Waiting for close lock at 1676127794713Disabling compacts and flushes for region at 1676127794713Disabling writes for close at 1676127794713Writing region close event to WAL at 1676127794713Closed at 1676127794713 2023-02-11 15:03:14,714 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf319fb70658e28d441d56e493ccb6fc, NAME => 'testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9ca200f280be5e80a4a0b8884c99d615, disabling compactions & flushes 2023-02-11 15:03:14,729 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. after waiting 0 ms 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,729 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cf319fb70658e28d441d56e493ccb6fc, disabling compactions & flushes 2023-02-11 15:03:14,729 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9ca200f280be5e80a4a0b8884c99d615: Waiting for close lock at 1676127794729Disabling compacts and flushes for region at 1676127794729Disabling writes for close at 1676127794729Writing region close event to WAL at 1676127794729Closed at 1676127794729 2023-02-11 15:03:14,729 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:14,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:14,730 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => bfe77e996473d1b33b11d212e64750a9, NAME => 'testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. after waiting 0 ms 2023-02-11 15:03:14,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:14,730 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:14,730 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cf319fb70658e28d441d56e493ccb6fc: Waiting for close lock at 1676127794729Disabling compacts and flushes for region at 1676127794729Disabling writes for close at 1676127794730 (+1 ms)Writing region close event to WAL at 1676127794730Closed at 1676127794730 2023-02-11 15:03:14,730 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 817fd165fbba9985d4bc3d37a70e7c96, NAME => 'testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ac89e902bd409aeb900a49780e6cd2f5, disabling compactions & flushes 2023-02-11 15:03:14,731 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:14,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:14,731 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. after waiting 0 ms 2023-02-11 15:03:14,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:14,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:14,732 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ac89e902bd409aeb900a49780e6cd2f5: Waiting for close lock at 1676127794731Disabling compacts and flushes for region at 1676127794731Disabling writes for close at 1676127794732 (+1 ms)Writing region close event to WAL at 1676127794732Closed at 1676127794732 2023-02-11 15:03:14,732 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 93c48782c0080b931692516a8b1de449, NAME => 'testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,742 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing bfe77e996473d1b33b11d212e64750a9, disabling compactions & flushes 2023-02-11 15:03:14,743 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:14,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:14,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. after waiting 0 ms 2023-02-11 15:03:14,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:14,743 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:14,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for bfe77e996473d1b33b11d212e64750a9: Waiting for close lock at 1676127794743Disabling compacts and flushes for region at 1676127794743Disabling writes for close at 1676127794743Writing region close event to WAL at 1676127794743Closed at 1676127794743 2023-02-11 15:03:14,743 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0fd82b649be69b7a9389f268a9e5ea6b, NAME => 'testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.tmp 2023-02-11 15:03:14,743 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 93c48782c0080b931692516a8b1de449, disabling compactions & flushes 2023-02-11 15:03:14,744 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:14,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:14,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. after waiting 0 ms 2023-02-11 15:03:14,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:14,744 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:14,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 93c48782c0080b931692516a8b1de449: Waiting for close lock at 1676127794744Disabling compacts and flushes for region at 1676127794744Disabling writes for close at 1676127794744Writing region close event to WAL at 1676127794744Closed at 1676127794744 2023-02-11 15:03:14,744 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 817fd165fbba9985d4bc3d37a70e7c96, disabling compactions & flushes 2023-02-11 15:03:14,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:14,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:14,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. after waiting 0 ms 2023-02-11 15:03:14,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:14,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:14,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 817fd165fbba9985d4bc3d37a70e7c96: Waiting for close lock at 1676127794745Disabling compacts and flushes for region at 1676127794745Disabling writes for close at 1676127794745Writing region close event to WAL at 1676127794745Closed at 1676127794745 2023-02-11 15:03:14,750 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:14,750 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0fd82b649be69b7a9389f268a9e5ea6b, disabling compactions & flushes 2023-02-11 15:03:14,750 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:14,750 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:14,750 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. after waiting 0 ms 2023-02-11 15:03:14,750 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:14,750 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:14,750 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0fd82b649be69b7a9389f268a9e5ea6b: Waiting for close lock at 1676127794750Disabling compacts and flushes for region at 1676127794750Disabling writes for close at 1676127794750Writing region close event to WAL at 1676127794750Closed at 1676127794750 2023-02-11 15:03:14,753 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127794753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127794753"}]},"ts":"1676127794753"} 2023-02-11 15:03:14,757 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 15:03:14,758 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:14,758 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127794758"}]},"ts":"1676127794758"} 2023-02-11 15:03:14,760 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 15:03:14,763 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:14,764 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46503%2C1676127793318, suffix=, logDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,46503,1676127793318, archiveDir=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/oldWALs, maxLogs=32 2023-02-11 15:03:14,771 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:14,771 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:14,772 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:14,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=734d9a680881f9d7559efd10e093fc24, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fd46c7a33b7ce6df81a694bff30024e, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f30072536f47d4a1465cf0f8579c3e7f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ca200f280be5e80a4a0b8884c99d615, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac89e902bd409aeb900a49780e6cd2f5, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf319fb70658e28d441d56e493ccb6fc, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bfe77e996473d1b33b11d212e64750a9, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=817fd165fbba9985d4bc3d37a70e7c96, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=93c48782c0080b931692516a8b1de449, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0fd82b649be69b7a9389f268a9e5ea6b, ASSIGN}] 2023-02-11 15:03:14,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:14,775 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0fd82b649be69b7a9389f268a9e5ea6b, ASSIGN 2023-02-11 15:03:14,775 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=817fd165fbba9985d4bc3d37a70e7c96, ASSIGN 2023-02-11 15:03:14,775 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bfe77e996473d1b33b11d212e64750a9, ASSIGN 2023-02-11 15:03:14,776 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=93c48782c0080b931692516a8b1de449, ASSIGN 2023-02-11 15:03:14,776 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cf319fb70658e28d441d56e493ccb6fc, ASSIGN 2023-02-11 15:03:14,776 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0fd82b649be69b7a9389f268a9e5ea6b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44339,1676127793280; forceNewPlan=false, retain=false 2023-02-11 15:03:14,776 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=817fd165fbba9985d4bc3d37a70e7c96, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1676127793318; forceNewPlan=false, retain=false 2023-02-11 15:03:14,776 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bfe77e996473d1b33b11d212e64750a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1676127793318; forceNewPlan=false, retain=false 2023-02-11 15:03:14,777 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=93c48782c0080b931692516a8b1de449, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44339,1676127793280; forceNewPlan=false, retain=false 2023-02-11 15:03:14,777 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cf319fb70658e28d441d56e493ccb6fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1676127793318; forceNewPlan=false, retain=false 2023-02-11 15:03:14,777 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac89e902bd409aeb900a49780e6cd2f5, ASSIGN 2023-02-11 15:03:14,777 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9ca200f280be5e80a4a0b8884c99d615, ASSIGN 2023-02-11 15:03:14,778 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f30072536f47d4a1465cf0f8579c3e7f, ASSIGN 2023-02-11 15:03:14,778 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fd46c7a33b7ce6df81a694bff30024e, ASSIGN 2023-02-11 15:03:14,778 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=734d9a680881f9d7559efd10e093fc24, ASSIGN 2023-02-11 15:03:14,779 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ac89e902bd409aeb900a49780e6cd2f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44339,1676127793280; forceNewPlan=false, retain=false 2023-02-11 15:03:14,779 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f30072536f47d4a1465cf0f8579c3e7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1676127793318; forceNewPlan=false, retain=false 2023-02-11 15:03:14,779 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9ca200f280be5e80a4a0b8884c99d615, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44339,1676127793280; forceNewPlan=false, retain=false 2023-02-11 15:03:14,780 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4fd46c7a33b7ce6df81a694bff30024e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44339,1676127793280; forceNewPlan=false, retain=false 2023-02-11 15:03:14,780 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=734d9a680881f9d7559efd10e093fc24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1676127793318; forceNewPlan=false, retain=false 2023-02-11 15:03:14,785 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK] 2023-02-11 15:03:14,785 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK] 2023-02-11 15:03:14,787 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/WALs/jenkins-hbase4.apache.org,46503,1676127793318/jenkins-hbase4.apache.org%2C46503%2C1676127793318.1676127794764 2023-02-11 15:03:14,787 DEBUG [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33089,DS-bbb2e79c-a94c-4ba6-b0e1-a00ffb694742,DISK], DatanodeInfoWithStorage[127.0.0.1:46551,DS-4c54bd5b-2b7e-4fe1-aedc-23f6d6f08b6e,DISK]] 2023-02-11 15:03:14,926 INFO [jenkins-hbase4:41051] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 15:03:14,930 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bfe77e996473d1b33b11d212e64750a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:14,930 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf319fb70658e28d441d56e493ccb6fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:14,930 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=734d9a680881f9d7559efd10e093fc24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:14,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f30072536f47d4a1465cf0f8579c3e7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:14,931 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794930"}]},"ts":"1676127794930"} 2023-02-11 15:03:14,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794930"}]},"ts":"1676127794930"} 2023-02-11 15:03:14,930 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=817fd165fbba9985d4bc3d37a70e7c96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:14,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127794930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794930"}]},"ts":"1676127794930"} 2023-02-11 15:03:14,931 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794930"}]},"ts":"1676127794930"} 2023-02-11 15:03:14,931 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794930"}]},"ts":"1676127794930"} 2023-02-11 15:03:14,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure cf319fb70658e28d441d56e493ccb6fc, server=jenkins-hbase4.apache.org,46503,1676127793318}] 2023-02-11 15:03:14,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure f30072536f47d4a1465cf0f8579c3e7f, server=jenkins-hbase4.apache.org,46503,1676127793318}] 2023-02-11 15:03:14,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 734d9a680881f9d7559efd10e093fc24, server=jenkins-hbase4.apache.org,46503,1676127793318}] 2023-02-11 15:03:14,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure bfe77e996473d1b33b11d212e64750a9, server=jenkins-hbase4.apache.org,46503,1676127793318}] 2023-02-11 15:03:14,938 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ac89e902bd409aeb900a49780e6cd2f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=18, state=RUNNABLE; OpenRegionProcedure 817fd165fbba9985d4bc3d37a70e7c96, server=jenkins-hbase4.apache.org,46503,1676127793318}] 2023-02-11 15:03:14,938 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794937"}]},"ts":"1676127794937"} 2023-02-11 15:03:14,938 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9ca200f280be5e80a4a0b8884c99d615, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794938"}]},"ts":"1676127794938"} 2023-02-11 15:03:14,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4fd46c7a33b7ce6df81a694bff30024e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,940 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794939"}]},"ts":"1676127794939"} 2023-02-11 15:03:14,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure ac89e902bd409aeb900a49780e6cd2f5, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:14,943 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 9ca200f280be5e80a4a0b8884c99d615, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:14,943 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=93c48782c0080b931692516a8b1de449, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,943 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127794943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794943"}]},"ts":"1676127794943"} 2023-02-11 15:03:14,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 4fd46c7a33b7ce6df81a694bff30024e, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:14,944 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0fd82b649be69b7a9389f268a9e5ea6b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:14,944 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127794944"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127794944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127794944"}]},"ts":"1676127794944"} 2023-02-11 15:03:14,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 93c48782c0080b931692516a8b1de449, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:14,948 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=20, state=RUNNABLE; OpenRegionProcedure 0fd82b649be69b7a9389f268a9e5ea6b, server=jenkins-hbase4.apache.org,44339,1676127793280}] 2023-02-11 15:03:14,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:15,085 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,085 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:15,088 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:15,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:15,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 817fd165fbba9985d4bc3d37a70e7c96, NAME => 'testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 15:03:15,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,094 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,095 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1 2023-02-11 15:03:15,095 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1 2023-02-11 15:03:15,095 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817fd165fbba9985d4bc3d37a70e7c96 columnFamilyName f1 2023-02-11 15:03:15,096 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(310): Store=817fd165fbba9985d4bc3d37a70e7c96/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,096 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,098 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2 2023-02-11 15:03:15,098 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2 2023-02-11 15:03:15,098 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817fd165fbba9985d4bc3d37a70e7c96 columnFamilyName f2 2023-02-11 15:03:15,099 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(310): Store=817fd165fbba9985d4bc3d37a70e7c96/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fd46c7a33b7ce6df81a694bff30024e, NAME => 'testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 15:03:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,100 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,102 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1 2023-02-11 15:03:15,102 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1 2023-02-11 15:03:15,102 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd46c7a33b7ce6df81a694bff30024e columnFamilyName f1 2023-02-11 15:03:15,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,103 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(310): Store=4fd46c7a33b7ce6df81a694bff30024e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,103 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:15,104 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2 2023-02-11 15:03:15,104 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2 2023-02-11 15:03:15,104 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd46c7a33b7ce6df81a694bff30024e columnFamilyName f2 2023-02-11 15:03:15,105 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(310): Store=4fd46c7a33b7ce6df81a694bff30024e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 817fd165fbba9985d4bc3d37a70e7c96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71583378, jitterRate=0.06667545437812805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 817fd165fbba9985d4bc3d37a70e7c96: Running coprocessor pre-open hook at 1676127795092Writing region info on filesystem at 1676127795092Initializing all the Stores at 1676127795093 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795093Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795093Cleaning up temporary data from old regions at 1676127795101 (+8 ms)Cleaning up detritus from prior splits at 1676127795101Running coprocessor post-open hooks at 1676127795107 (+6 ms)Region opened successfully at 1676127795107 2023-02-11 15:03:15,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96., pid=25, masterSystemTime=1676127795084 2023-02-11 15:03:15,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:15,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:15,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f30072536f47d4a1465cf0f8579c3e7f, NAME => 'testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 15:03:15,113 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=817fd165fbba9985d4bc3d37a70e7c96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,113 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795113"}]},"ts":"1676127795113"} 2023-02-11 15:03:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:15,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=18 2023-02-11 15:03:15,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=18, state=SUCCESS; OpenRegionProcedure 817fd165fbba9985d4bc3d37a70e7c96, server=jenkins-hbase4.apache.org,46503,1676127793318 in 177 msec 2023-02-11 15:03:15,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=817fd165fbba9985d4bc3d37a70e7c96, ASSIGN in 344 msec 2023-02-11 15:03:15,120 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,122 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1 2023-02-11 15:03:15,122 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1 2023-02-11 15:03:15,122 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f30072536f47d4a1465cf0f8579c3e7f columnFamilyName f1 2023-02-11 15:03:15,122 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(310): Store=f30072536f47d4a1465cf0f8579c3e7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,123 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,124 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2 2023-02-11 15:03:15,125 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2 2023-02-11 15:03:15,125 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f30072536f47d4a1465cf0f8579c3e7f columnFamilyName f2 2023-02-11 15:03:15,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fd46c7a33b7ce6df81a694bff30024e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66551742, jitterRate=-0.008301764726638794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fd46c7a33b7ce6df81a694bff30024e: Running coprocessor pre-open hook at 1676127795099Writing region info on filesystem at 1676127795099Initializing all the Stores at 1676127795100 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795100Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795100Cleaning up temporary data from old regions at 1676127795108 (+8 ms)Cleaning up detritus from prior splits at 1676127795110 (+2 ms)Running coprocessor post-open hooks at 1676127795125 (+15 ms)Region opened successfully at 1676127795125 2023-02-11 15:03:15,126 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(310): Store=f30072536f47d4a1465cf0f8579c3e7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e., pid=28, masterSystemTime=1676127795096 2023-02-11 15:03:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:15,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:15,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:15,128 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=4fd46c7a33b7ce6df81a694bff30024e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9ca200f280be5e80a4a0b8884c99d615, NAME => 'testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 15:03:15,128 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795128"}]},"ts":"1676127795128"} 2023-02-11 15:03:15,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,130 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:15,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-11 15:03:15,132 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1 2023-02-11 15:03:15,132 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1 2023-02-11 15:03:15,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 4fd46c7a33b7ce6df81a694bff30024e, server=jenkins-hbase4.apache.org,44339,1676127793280 in 186 msec 2023-02-11 15:03:15,132 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ca200f280be5e80a4a0b8884c99d615 columnFamilyName f1 2023-02-11 15:03:15,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,133 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(310): Store=9ca200f280be5e80a4a0b8884c99d615/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,133 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fd46c7a33b7ce6df81a694bff30024e, ASSIGN in 360 msec 2023-02-11 15:03:15,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f30072536f47d4a1465cf0f8579c3e7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60400816, jitterRate=-0.09995770454406738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f30072536f47d4a1465cf0f8579c3e7f: Running coprocessor pre-open hook at 1676127795113Writing region info on filesystem at 1676127795113Initializing all the Stores at 1676127795114 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795114Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795120 (+6 ms)Cleaning up temporary data from old regions at 1676127795127 (+7 ms)Cleaning up detritus from prior splits at 1676127795128 (+1 ms)Running coprocessor post-open hooks at 1676127795134 (+6 ms)Region opened successfully at 1676127795134 2023-02-11 15:03:15,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f., pid=22, masterSystemTime=1676127795084 2023-02-11 15:03:15,135 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2 2023-02-11 15:03:15,135 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2 2023-02-11 15:03:15,135 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ca200f280be5e80a4a0b8884c99d615 columnFamilyName f2 2023-02-11 15:03:15,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:15,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:15,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:15,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f30072536f47d4a1465cf0f8579c3e7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bfe77e996473d1b33b11d212e64750a9, NAME => 'testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 15:03:15,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795136"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795136"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795136"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795136"}]},"ts":"1676127795136"} 2023-02-11 15:03:15,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,137 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(310): Store=9ca200f280be5e80a4a0b8884c99d615/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,138 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-11 15:03:15,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure f30072536f47d4a1465cf0f8579c3e7f, server=jenkins-hbase4.apache.org,46503,1676127793318 in 205 msec 2023-02-11 15:03:15,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f30072536f47d4a1465cf0f8579c3e7f, ASSIGN in 368 msec 2023-02-11 15:03:15,141 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1 2023-02-11 15:03:15,141 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1 2023-02-11 15:03:15,142 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfe77e996473d1b33b11d212e64750a9 columnFamilyName f1 2023-02-11 15:03:15,142 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(310): Store=bfe77e996473d1b33b11d212e64750a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,142 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:15,148 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2 2023-02-11 15:03:15,148 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2 2023-02-11 15:03:15,148 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfe77e996473d1b33b11d212e64750a9 columnFamilyName f2 2023-02-11 15:03:15,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,149 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(310): Store=bfe77e996473d1b33b11d212e64750a9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9ca200f280be5e80a4a0b8884c99d615; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64730312, jitterRate=-0.03544318675994873}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9ca200f280be5e80a4a0b8884c99d615: Running coprocessor pre-open hook at 1676127795129Writing region info on filesystem at 1676127795129Initializing all the Stores at 1676127795130 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795130Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795130Cleaning up temporary data from old regions at 1676127795139 (+9 ms)Cleaning up detritus from prior splits at 1676127795140 (+1 ms)Running coprocessor post-open hooks at 1676127795149 (+9 ms)Region opened successfully at 1676127795149 2023-02-11 15:03:15,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615., pid=27, masterSystemTime=1676127795096 2023-02-11 15:03:15,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:15,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:15,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:15,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93c48782c0080b931692516a8b1de449, NAME => 'testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 15:03:15,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,153 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9ca200f280be5e80a4a0b8884c99d615, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,153 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795153"}]},"ts":"1676127795153"} 2023-02-11 15:03:15,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,154 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:15,156 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1 2023-02-11 15:03:15,156 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1 2023-02-11 15:03:15,156 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93c48782c0080b931692516a8b1de449 columnFamilyName f1 2023-02-11 15:03:15,157 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(310): Store=93c48782c0080b931692516a8b1de449/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,157 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bfe77e996473d1b33b11d212e64750a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73754553, jitterRate=0.09902848303318024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bfe77e996473d1b33b11d212e64750a9: Running coprocessor pre-open hook at 1676127795137Writing region info on filesystem at 1676127795137Initializing all the Stores at 1676127795138 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795138Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795138Cleaning up temporary data from old regions at 1676127795152 (+14 ms)Cleaning up detritus from prior splits at 1676127795153 (+1 ms)Running coprocessor post-open hooks at 1676127795158 (+5 ms)Region opened successfully at 1676127795158 2023-02-11 15:03:15,159 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2 2023-02-11 15:03:15,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9., pid=24, masterSystemTime=1676127795084 2023-02-11 15:03:15,159 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2 2023-02-11 15:03:15,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-11 15:03:15,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 9ca200f280be5e80a4a0b8884c99d615, server=jenkins-hbase4.apache.org,44339,1676127793280 in 214 msec 2023-02-11 15:03:15,159 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93c48782c0080b931692516a8b1de449 columnFamilyName f2 2023-02-11 15:03:15,160 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(310): Store=93c48782c0080b931692516a8b1de449/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9ca200f280be5e80a4a0b8884c99d615, ASSIGN in 387 msec 2023-02-11 15:03:15,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:15,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf319fb70658e28d441d56e493ccb6fc, NAME => 'testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 15:03:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,162 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bfe77e996473d1b33b11d212e64750a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,163 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795162"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795162"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795162"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795162"}]},"ts":"1676127795162"} 2023-02-11 15:03:15,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,165 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:15,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-11 15:03:15,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure bfe77e996473d1b33b11d212e64750a9, server=jenkins-hbase4.apache.org,46503,1676127793318 in 227 msec 2023-02-11 15:03:15,167 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1 2023-02-11 15:03:15,167 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1 2023-02-11 15:03:15,167 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf319fb70658e28d441d56e493ccb6fc columnFamilyName f1 2023-02-11 15:03:15,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bfe77e996473d1b33b11d212e64750a9, ASSIGN in 394 msec 2023-02-11 15:03:15,168 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(310): Store=cf319fb70658e28d441d56e493ccb6fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,168 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 93c48782c0080b931692516a8b1de449; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68154345, jitterRate=0.015578880906105042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 93c48782c0080b931692516a8b1de449: Running coprocessor pre-open hook at 1676127795153Writing region info on filesystem at 1676127795153Initializing all the Stores at 1676127795154 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795154Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795154Cleaning up temporary data from old regions at 1676127795163 (+9 ms)Cleaning up detritus from prior splits at 1676127795163Running coprocessor post-open hooks at 1676127795169 (+6 ms)Region opened successfully at 1676127795169 2023-02-11 15:03:15,169 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2 2023-02-11 15:03:15,169 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2 2023-02-11 15:03:15,170 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf319fb70658e28d441d56e493ccb6fc columnFamilyName f2 2023-02-11 15:03:15,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449., pid=29, masterSystemTime=1676127795096 2023-02-11 15:03:15,171 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(310): Store=cf319fb70658e28d441d56e493ccb6fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:15,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:15,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:15,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0fd82b649be69b7a9389f268a9e5ea6b, NAME => 'testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 15:03:15,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=93c48782c0080b931692516a8b1de449, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795172"}]},"ts":"1676127795172"} 2023-02-11 15:03:15,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,175 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,176 DEBUG [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/f1 2023-02-11 15:03:15,176 DEBUG [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/f1 2023-02-11 15:03:15,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-11 15:03:15,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 93c48782c0080b931692516a8b1de449, server=jenkins-hbase4.apache.org,44339,1676127793280 in 229 msec 2023-02-11 15:03:15,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:15,177 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fd82b649be69b7a9389f268a9e5ea6b columnFamilyName f1 2023-02-11 15:03:15,177 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(310): Store=0fd82b649be69b7a9389f268a9e5ea6b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,177 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=93c48782c0080b931692516a8b1de449, ASSIGN in 404 msec 2023-02-11 15:03:15,179 DEBUG [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/f2 2023-02-11 15:03:15,179 DEBUG [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/f2 2023-02-11 15:03:15,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,179 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fd82b649be69b7a9389f268a9e5ea6b columnFamilyName f2 2023-02-11 15:03:15,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cf319fb70658e28d441d56e493ccb6fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62897813, jitterRate=-0.06274954974651337}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cf319fb70658e28d441d56e493ccb6fc: Running coprocessor pre-open hook at 1676127795163Writing region info on filesystem at 1676127795163Initializing all the Stores at 1676127795164 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795164Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795165 (+1 ms)Cleaning up temporary data from old regions at 1676127795173 (+8 ms)Cleaning up detritus from prior splits at 1676127795174 (+1 ms)Running coprocessor post-open hooks at 1676127795180 (+6 ms)Region opened successfully at 1676127795180 2023-02-11 15:03:15,180 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(310): Store=0fd82b649be69b7a9389f268a9e5ea6b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc., pid=21, masterSystemTime=1676127795084 2023-02-11 15:03:15,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:15,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:15,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:15,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 734d9a680881f9d7559efd10e093fc24, NAME => 'testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 15:03:15,182 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cf319fb70658e28d441d56e493ccb6fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795182"}]},"ts":"1676127795182"} 2023-02-11 15:03:15,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,184 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,186 DEBUG [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/f1 2023-02-11 15:03:15,186 DEBUG [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/f1 2023-02-11 15:03:15,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:15,187 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 734d9a680881f9d7559efd10e093fc24 columnFamilyName f1 2023-02-11 15:03:15,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-11 15:03:15,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure cf319fb70658e28d441d56e493ccb6fc, server=jenkins-hbase4.apache.org,46503,1676127793318 in 252 msec 2023-02-11 15:03:15,188 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(310): Store=734d9a680881f9d7559efd10e093fc24/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,188 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cf319fb70658e28d441d56e493ccb6fc, ASSIGN in 415 msec 2023-02-11 15:03:15,189 DEBUG [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/f2 2023-02-11 15:03:15,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,190 DEBUG [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/f2 2023-02-11 15:03:15,190 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 734d9a680881f9d7559efd10e093fc24 columnFamilyName f2 2023-02-11 15:03:15,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0fd82b649be69b7a9389f268a9e5ea6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69827029, jitterRate=0.040503814816474915}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0fd82b649be69b7a9389f268a9e5ea6b: Running coprocessor pre-open hook at 1676127795173Writing region info on filesystem at 1676127795173Initializing all the Stores at 1676127795174 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795174Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795174Cleaning up temporary data from old regions at 1676127795183 (+9 ms)Cleaning up detritus from prior splits at 1676127795184 (+1 ms)Running coprocessor post-open hooks at 1676127795190 (+6 ms)Region opened successfully at 1676127795190 2023-02-11 15:03:15,191 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(310): Store=734d9a680881f9d7559efd10e093fc24/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b., pid=30, masterSystemTime=1676127795096 2023-02-11 15:03:15,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:15,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:15,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:15,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ac89e902bd409aeb900a49780e6cd2f5, NAME => 'testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 15:03:15,193 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0fd82b649be69b7a9389f268a9e5ea6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127795193"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795193"}]},"ts":"1676127795193"} 2023-02-11 15:03:15,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:15,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,196 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=20 2023-02-11 15:03:15,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=20, state=SUCCESS; OpenRegionProcedure 0fd82b649be69b7a9389f268a9e5ea6b, server=jenkins-hbase4.apache.org,44339,1676127793280 in 247 msec 2023-02-11 15:03:15,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,198 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1 2023-02-11 15:03:15,198 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1 2023-02-11 15:03:15,199 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac89e902bd409aeb900a49780e6cd2f5 columnFamilyName f1 2023-02-11 15:03:15,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0fd82b649be69b7a9389f268a9e5ea6b, ASSIGN in 425 msec 2023-02-11 15:03:15,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:15,200 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(310): Store=ac89e902bd409aeb900a49780e6cd2f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,200 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,201 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2 2023-02-11 15:03:15,201 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2 2023-02-11 15:03:15,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,202 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac89e902bd409aeb900a49780e6cd2f5 columnFamilyName f2 2023-02-11 15:03:15,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 734d9a680881f9d7559efd10e093fc24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69946327, jitterRate=0.04228149354457855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 734d9a680881f9d7559efd10e093fc24: Running coprocessor pre-open hook at 1676127795183Writing region info on filesystem at 1676127795183Initializing all the Stores at 1676127795184 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795184Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795184Cleaning up temporary data from old regions at 1676127795196 (+12 ms)Cleaning up detritus from prior splits at 1676127795196Running coprocessor post-open hooks at 1676127795202 (+6 ms)Region opened successfully at 1676127795202 2023-02-11 15:03:15,202 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(310): Store=ac89e902bd409aeb900a49780e6cd2f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:15,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24., pid=23, masterSystemTime=1676127795084 2023-02-11 15:03:15,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:15,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:15,205 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=734d9a680881f9d7559efd10e093fc24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676127795205"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795205"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795205"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795205"}]},"ts":"1676127795205"} 2023-02-11 15:03:15,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:15,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:15,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-11 15:03:15,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 734d9a680881f9d7559efd10e093fc24, server=jenkins-hbase4.apache.org,46503,1676127793318 in 272 msec 2023-02-11 15:03:15,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:15,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=734d9a680881f9d7559efd10e093fc24, ASSIGN in 437 msec 2023-02-11 15:03:15,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ac89e902bd409aeb900a49780e6cd2f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74161437, jitterRate=0.10509152710437775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:15,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ac89e902bd409aeb900a49780e6cd2f5: Running coprocessor pre-open hook at 1676127795194Writing region info on filesystem at 1676127795194Initializing all the Stores at 1676127795196 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795196Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127795196Cleaning up temporary data from old regions at 1676127795205 (+9 ms)Cleaning up detritus from prior splits at 1676127795205Running coprocessor post-open hooks at 1676127795210 (+5 ms)Region opened successfully at 1676127795210 2023-02-11 15:03:15,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5., pid=26, masterSystemTime=1676127795096 2023-02-11 15:03:15,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:15,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:15,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ac89e902bd409aeb900a49780e6cd2f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676127795213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127795213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127795213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127795213"}]},"ts":"1676127795213"} 2023-02-11 15:03:15,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-11 15:03:15,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure ac89e902bd409aeb900a49780e6cd2f5, server=jenkins-hbase4.apache.org,44339,1676127793280 in 274 msec 2023-02-11 15:03:15,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-11 15:03:15,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ac89e902bd409aeb900a49780e6cd2f5, ASSIGN in 444 msec 2023-02-11 15:03:15,218 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:15,218 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127795218"}]},"ts":"1676127795218"} 2023-02-11 15:03:15,219 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 15:03:15,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:15,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 554 msec 2023-02-11 15:03:15,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:15,282 INFO [Listener at localhost/33637] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 15:03:15,282 DEBUG [Listener at localhost/33637] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 15:03:15,282 INFO [Listener at localhost/33637] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:15,286 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 15:03:15,286 INFO [Listener at localhost/33637] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:15,287 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 15:03:15,287 INFO [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:15,356 DEBUG [hconnection-0x64ae4e2-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:15,390 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:15,395 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:15,404 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46503] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:15,506 INFO [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:15,506 INFO [Listener at localhost/33637] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:15,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:15,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127795507 (current time:1676127795507). 2023-02-11 15:03:15,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:15,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] zookeeper.ReadOnlyZKClient(139): Connect 0x1adf41e9 to 127.0.0.1:64464 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:15,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4090aa1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:15,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:15,519 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51090, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:15,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1adf41e9 to 127.0.0.1:64464 2023-02-11 15:03:15,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:15,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:15,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:15,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:15,525 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:15,526 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676128395526 2023-02-11 15:03:15,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:15,527 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 15:03:15,528 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:15,528 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:15,529 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:15,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:15,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-11 15:03:15,530 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:15,531 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676128395531 2023-02-11 15:03:15,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,556 INFO [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-11 15:03:15,556 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:15,556 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-11 15:03:15,556 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-11 15:03:15,557 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,557 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,558 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:15,558 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:15,558 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:15,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:15,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:15,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:15,559 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,559 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,559 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,559 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:15,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-11 15:03:15,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-11 15:03:15,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 15:03:15,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-11 15:03:15,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-11 15:03:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:15,568 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-11 15:03:15,568 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-11 15:03:15,568 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-11 15:03:15,568 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:15,568 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44339,1676127793280' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-11 15:03:15,569 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-11 15:03:15,569 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-11 15:03:15,569 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46503,1676127793318' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-11 15:03:15,571 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,571 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:15,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:15,572 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,572 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,572 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:15,572 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:15,573 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,573 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44339,1676127793280' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e61205[Count = 1] remaining members to acquire global barrier 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:15,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46503,1676127793318' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-11 15:03:15,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e61205[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:15,576 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-11 15:03:15,576 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,577 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,578 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,578 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:15,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,578 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,578 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:15,578 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:15,578 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. started... 2023-02-11 15:03:15,578 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,578 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:15,578 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:15,578 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. started... 2023-02-11 15:03:15,580 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 734d9a680881f9d7559efd10e093fc24: 2023-02-11 15:03:15,580 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 93c48782c0080b931692516a8b1de449 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 15:03:15,581 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,581 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,581 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:15,581 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:15,585 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:15,585 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 15:03:15,585 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:15,585 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. started... 2023-02-11 15:03:15,585 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:15,586 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:15,587 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. started... 2023-02-11 15:03:15,586 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4fd46c7a33b7ce6df81a694bff30024e 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 15:03:15,586 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 15:03:15,587 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 817fd165fbba9985d4bc3d37a70e7c96 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:15,585 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:15,587 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:15,587 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. started... 2023-02-11 15:03:15,588 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. started... 2023-02-11 15:03:15,589 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HRegion(2744): Flushing ac89e902bd409aeb900a49780e6cd2f5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:15,590 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HRegion(2744): Flushing f30072536f47d4a1465cf0f8579c3e7f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:15,628 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:15,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:15,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:15,630 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:15,636 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. completed. 2023-02-11 15:03:15,636 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:15,636 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:15,636 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 15:03:15,636 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. started... 2023-02-11 15:03:15,647 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cf319fb70658e28d441d56e493ccb6fc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:15,656 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f1/16fe43b1a6be489ebf7d85c7dd34c363 2023-02-11 15:03:15,660 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f1/8af158a992014e97bbee8513fbc6a8ac 2023-02-11 15:03:15,667 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f1/762c7d551207481fa575fd504cfb7279 2023-02-11 15:03:15,678 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f1/f1cb15348fba41e7974c9a8069ddd03a 2023-02-11 15:03:15,705 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f1/71ce5132603f4fe0b90959865ace3021 2023-02-11 15:03:15,706 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f1/69870b3d1c32411291cc131eedef479e 2023-02-11 15:03:15,718 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f2/1b20cefee632461f8233cc22857b4f9a 2023-02-11 15:03:15,724 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f2/c64c2d1769a7441193cda2b9bdbd114d 2023-02-11 15:03:15,726 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f1/16fe43b1a6be489ebf7d85c7dd34c363 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/16fe43b1a6be489ebf7d85c7dd34c363 2023-02-11 15:03:15,731 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f1/8af158a992014e97bbee8513fbc6a8ac as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/8af158a992014e97bbee8513fbc6a8ac 2023-02-11 15:03:15,737 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/8af158a992014e97bbee8513fbc6a8ac, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:15,738 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f2/c64c2d1769a7441193cda2b9bdbd114d as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/c64c2d1769a7441193cda2b9bdbd114d 2023-02-11 15:03:15,742 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/16fe43b1a6be489ebf7d85c7dd34c363, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:15,743 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f2/1b20cefee632461f8233cc22857b4f9a as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/1b20cefee632461f8233cc22857b4f9a 2023-02-11 15:03:15,746 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/c64c2d1769a7441193cda2b9bdbd114d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:15,747 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4fd46c7a33b7ce6df81a694bff30024e in 161ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,747 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-11 15:03:15,748 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4fd46c7a33b7ce6df81a694bff30024e: 2023-02-11 15:03:15,748 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,748 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,748 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/8af158a992014e97bbee8513fbc6a8ac] hfiles 2023-02-11 15:03:15,749 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/8af158a992014e97bbee8513fbc6a8ac for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,749 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/c64c2d1769a7441193cda2b9bdbd114d] hfiles 2023-02-11 15:03:15,749 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/c64c2d1769a7441193cda2b9bdbd114d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,761 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f2/c3adb43e8fb34bbfad967a69bba45d6a 2023-02-11 15:03:15,770 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f1/762c7d551207481fa575fd504cfb7279 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/762c7d551207481fa575fd504cfb7279 2023-02-11 15:03:15,772 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f2/33f71c6e1f4e49d49915953fb6024a4e 2023-02-11 15:03:15,776 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/1b20cefee632461f8233cc22857b4f9a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:15,777 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 93c48782c0080b931692516a8b1de449 in 197ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,780 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f2/c86623944239417f972b8bff806c0afb 2023-02-11 15:03:15,780 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f1/f1cb15348fba41e7974c9a8069ddd03a as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/f1cb15348fba41e7974c9a8069ddd03a 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 93c48782c0080b931692516a8b1de449: 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,785 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f2/058628f0c5df4ed6995eb829d165011b 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/16fe43b1a6be489ebf7d85c7dd34c363] hfiles 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/16fe43b1a6be489ebf7d85c7dd34c363 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/1b20cefee632461f8233cc22857b4f9a] hfiles 2023-02-11 15:03:15,785 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/1b20cefee632461f8233cc22857b4f9a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,792 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/762c7d551207481fa575fd504cfb7279, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,793 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f2/c3adb43e8fb34bbfad967a69bba45d6a as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/c3adb43e8fb34bbfad967a69bba45d6a 2023-02-11 15:03:15,796 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f1/71ce5132603f4fe0b90959865ace3021 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/71ce5132603f4fe0b90959865ace3021 2023-02-11 15:03:15,799 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/f1cb15348fba41e7974c9a8069ddd03a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,799 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/c3adb43e8fb34bbfad967a69bba45d6a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,800 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. completed. 2023-02-11 15:03:15,800 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:15,800 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:15,800 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 15:03:15,800 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. started... 2023-02-11 15:03:15,800 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 9ca200f280be5e80a4a0b8884c99d615 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:15,801 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f2/33f71c6e1f4e49d49915953fb6024a4e as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/33f71c6e1f4e49d49915953fb6024a4e 2023-02-11 15:03:15,804 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 817fd165fbba9985d4bc3d37a70e7c96 in 217ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,804 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 817fd165fbba9985d4bc3d37a70e7c96: 2023-02-11 15:03:15,805 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,805 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,805 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/762c7d551207481fa575fd504cfb7279] hfiles 2023-02-11 15:03:15,805 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/762c7d551207481fa575fd504cfb7279 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,805 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/c3adb43e8fb34bbfad967a69bba45d6a] hfiles 2023-02-11 15:03:15,805 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/c3adb43e8fb34bbfad967a69bba45d6a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,823 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/33f71c6e1f4e49d49915953fb6024a4e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,823 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/71ce5132603f4fe0b90959865ace3021, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,824 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f1/69870b3d1c32411291cc131eedef479e as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/69870b3d1c32411291cc131eedef479e 2023-02-11 15:03:15,824 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f2/c86623944239417f972b8bff806c0afb as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/c86623944239417f972b8bff806c0afb 2023-02-11 15:03:15,828 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f30072536f47d4a1465cf0f8579c3e7f in 238ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for f30072536f47d4a1465cf0f8579c3e7f: 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/f1cb15348fba41e7974c9a8069ddd03a] hfiles 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/f1cb15348fba41e7974c9a8069ddd03a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/33f71c6e1f4e49d49915953fb6024a4e] hfiles 2023-02-11 15:03:15,828 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/33f71c6e1f4e49d49915953fb6024a4e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,830 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:15,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:15,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:15,832 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 15:03:15,840 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. completed. 2023-02-11 15:03:15,840 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:15,840 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:15,840 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 15:03:15,840 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. started... 2023-02-11 15:03:15,841 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0fd82b649be69b7a9389f268a9e5ea6b: 2023-02-11 15:03:15,841 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,841 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,841 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:15,841 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:15,846 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/69870b3d1c32411291cc131eedef479e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,847 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f2/058628f0c5df4ed6995eb829d165011b as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/058628f0c5df4ed6995eb829d165011b 2023-02-11 15:03:15,857 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. completed. 2023-02-11 15:03:15,857 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:15,857 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:15,857 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. started... 2023-02-11 15:03:15,858 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bfe77e996473d1b33b11d212e64750a9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:15,857 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 15:03:15,865 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/058628f0c5df4ed6995eb829d165011b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,866 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/c86623944239417f972b8bff806c0afb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,866 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cf319fb70658e28d441d56e493ccb6fc in 219ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,867 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ac89e902bd409aeb900a49780e6cd2f5 in 278ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cf319fb70658e28d441d56e493ccb6fc: 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ac89e902bd409aeb900a49780e6cd2f5: 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/69870b3d1c32411291cc131eedef479e] hfiles 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/69870b3d1c32411291cc131eedef479e for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/71ce5132603f4fe0b90959865ace3021] hfiles 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/058628f0c5df4ed6995eb829d165011b] hfiles 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/71ce5132603f4fe0b90959865ace3021 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,867 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/058628f0c5df4ed6995eb829d165011b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,868 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/c86623944239417f972b8bff806c0afb] hfiles 2023-02-11 15:03:15,868 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/c86623944239417f972b8bff806c0afb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,876 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f1/8face590ab7242fdb6eaccd4654509c3 2023-02-11 15:03:15,892 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. completed. 2023-02-11 15:03:15,892 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:15,892 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 15:03:15,912 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. completed. 2023-02-11 15:03:15,912 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:15,912 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 15:03:15,912 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f1/89c08749c09f4e2192f576217acdab69 2023-02-11 15:03:15,921 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. completed. 2023-02-11 15:03:15,921 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:15,921 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 15:03:15,924 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f2/50e3386b7f4645ce980bf14cce8e99fa 2023-02-11 15:03:15,930 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f1/8face590ab7242fdb6eaccd4654509c3 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/8face590ab7242fdb6eaccd4654509c3 2023-02-11 15:03:15,938 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f2/7e73a432a0b440e89afdb4902ceaf617 2023-02-11 15:03:15,940 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/8face590ab7242fdb6eaccd4654509c3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,941 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f2/50e3386b7f4645ce980bf14cce8e99fa as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/50e3386b7f4645ce980bf14cce8e99fa 2023-02-11 15:03:15,944 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f1/89c08749c09f4e2192f576217acdab69 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/89c08749c09f4e2192f576217acdab69 2023-02-11 15:03:15,947 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/50e3386b7f4645ce980bf14cce8e99fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,948 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9ca200f280be5e80a4a0b8884c99d615 in 148ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,948 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9ca200f280be5e80a4a0b8884c99d615: 2023-02-11 15:03:15,948 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,948 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,949 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/8face590ab7242fdb6eaccd4654509c3] hfiles 2023-02-11 15:03:15,949 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/8face590ab7242fdb6eaccd4654509c3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,949 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/50e3386b7f4645ce980bf14cce8e99fa] hfiles 2023-02-11 15:03:15,949 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/50e3386b7f4645ce980bf14cce8e99fa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,950 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/89c08749c09f4e2192f576217acdab69, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,951 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f2/7e73a432a0b440e89afdb4902ceaf617 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/7e73a432a0b440e89afdb4902ceaf617 2023-02-11 15:03:15,956 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. completed. 2023-02-11 15:03:15,956 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:15,956 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 15:03:15,956 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 15:03:15,956 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,957 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-11 15:03:15,957 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,44339,1676127793280' in zk 2023-02-11 15:03:15,957 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/7e73a432a0b440e89afdb4902ceaf617, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:15,958 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bfe77e996473d1b33b11d212e64750a9 in 100ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bfe77e996473d1b33b11d212e64750a9: 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/89c08749c09f4e2192f576217acdab69] hfiles 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/89c08749c09f4e2192f576217acdab69 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/7e73a432a0b440e89afdb4902ceaf617] hfiles 2023-02-11 15:03:15,958 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/7e73a432a0b440e89afdb4902ceaf617 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,959 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,959 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-11 15:03:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:15,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:15,959 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:15,959 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-11 15:03:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:15,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,44339,1676127793280': 2023-02-11 15:03:15,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44339,1676127793280' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 15:03:15,970 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. completed. 2023-02-11 15:03:15,970 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:15,971 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 15:03:16,054 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:16,132 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:16,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:16,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:16,134 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 15:03:16,279 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. completed. 2023-02-11 15:03:16,279 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 15:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 15:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-11 15:03:16,280 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,46503,1676127793318' in zk 2023-02-11 15:03:16,281 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-11 15:03:16,281 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,282 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:16,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:16,282 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-11 15:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,46503,1676127793318': 2023-02-11 15:03:16,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46503,1676127793318' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:16,286 INFO [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-11 15:03:16,286 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:16,286 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:16,286 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,286 INFO [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:16,288 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,288 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,288 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:16,288 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:16,288 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:16,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,289 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:16,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:16,289 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:16,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:16,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,291 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,291 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,301 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:16,301 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:16,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:16,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:16,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion because node does not exist (not an error) 2023-02-11 15:03:16,302 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:16,302 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:16,302 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:16,301 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:16,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:16,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:16,303 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,304 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-11 15:03:16,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,357 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:16,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676127795527Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676127796302 (+775 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676127796303 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676127796313 (+10 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676127796324 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676127796357 (+33 ms) 2023-02-11 15:03:16,359 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:16,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 831 msec 2023-02-11 15:03:16,635 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:16,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:16,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:16,637 INFO [Listener at localhost/33637] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:16,643 INFO [Listener at localhost/33637] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:16,655 INFO [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:16,984 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46503] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,016 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44339] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,105 INFO [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:17,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:17,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 15:03:17,115 INFO [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 15:03:17,115 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:17,116 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 15:03:17,116 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 15:03:17,116 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,117 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,118 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:17,118 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:17,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:17,118 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,119 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,119 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 15:03:17,120 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,120 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:17,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 15:03:17,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 15:03:17,124 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 15:03:17,124 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:17,125 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 15:03:17,125 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 15:03:17,125 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:17,128 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 15:03:17,128 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,129 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. started... 2023-02-11 15:03:17,129 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,129 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. started... 2023-02-11 15:03:17,129 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 93c48782c0080b931692516a8b1de449 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 15:03:17,129 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4fd46c7a33b7ce6df81a694bff30024e 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 15:03:17,132 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,133 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,133 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. started... 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 734d9a680881f9d7559efd10e093fc24: 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. started... 2023-02-11 15:03:17,133 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,134 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf319fb70658e28d441d56e493ccb6fc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:17,133 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. started... 2023-02-11 15:03:17,135 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 817fd165fbba9985d4bc3d37a70e7c96 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:17,134 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. started... 2023-02-11 15:03:17,133 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 15:03:17,141 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:17,141 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 15:03:17,133 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. started... 2023-02-11 15:03:17,142 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ac89e902bd409aeb900a49780e6cd2f5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:17,140 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing f30072536f47d4a1465cf0f8579c3e7f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:17,135 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:17,184 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f1/152543fc48424c0bba3780934429cc0b 2023-02-11 15:03:17,185 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f1/61a42c72c819423da144e2e4d0c42450 2023-02-11 15:03:17,191 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f1/42878969793341b49f5c15e9a393725c 2023-02-11 15:03:17,191 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f1/4522ad1184d84a43bafc2dcf32257fbf 2023-02-11 15:03:17,191 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f1/4d5d197b9b8844c6ada909ac231f7cee 2023-02-11 15:03:17,212 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f1/bc340a78606e498db678b91cfbf934f2 2023-02-11 15:03:17,236 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f2/10f2a8fde1ef4ea2bc2d589673b19d85 2023-02-11 15:03:17,240 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f2/f6547dbc1d5c42eb810d0e093e23065e 2023-02-11 15:03:17,253 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f1/152543fc48424c0bba3780934429cc0b as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/152543fc48424c0bba3780934429cc0b 2023-02-11 15:03:17,254 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f1/61a42c72c819423da144e2e4d0c42450 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/61a42c72c819423da144e2e4d0c42450 2023-02-11 15:03:17,258 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/152543fc48424c0bba3780934429cc0b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:17,259 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/.tmp/f2/f6547dbc1d5c42eb810d0e093e23065e as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/f6547dbc1d5c42eb810d0e093e23065e 2023-02-11 15:03:17,260 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/61a42c72c819423da144e2e4d0c42450, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,261 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/.tmp/f2/10f2a8fde1ef4ea2bc2d589673b19d85 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/10f2a8fde1ef4ea2bc2d589673b19d85 2023-02-11 15:03:17,265 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/10f2a8fde1ef4ea2bc2d589673b19d85, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,266 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f30072536f47d4a1465cf0f8579c3e7f in 131ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,266 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for f30072536f47d4a1465cf0f8579c3e7f: 2023-02-11 15:03:17,266 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,268 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,268 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 15:03:17,268 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. started... 2023-02-11 15:03:17,268 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bfe77e996473d1b33b11d212e64750a9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:17,270 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/f6547dbc1d5c42eb810d0e093e23065e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:17,272 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4fd46c7a33b7ce6df81a694bff30024e in 143ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,272 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4fd46c7a33b7ce6df81a694bff30024e: 2023-02-11 15:03:17,272 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,275 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,275 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 15:03:17,275 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. started... 2023-02-11 15:03:17,280 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9ca200f280be5e80a4a0b8884c99d615 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:17,280 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f2/76f6eb0f3e4d4f18900021ea3529a69a 2023-02-11 15:03:17,288 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f2/4f7ec7df06d2418c852eca754c55c0a4 2023-02-11 15:03:17,289 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f2/d00516a7d61443d39808e4fc3a30d886 2023-02-11 15:03:17,291 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f1/42878969793341b49f5c15e9a393725c as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/42878969793341b49f5c15e9a393725c 2023-02-11 15:03:17,296 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f2/dda27dcd141440209a7cff0c6fd82072 2023-02-11 15:03:17,298 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f1/bc340a78606e498db678b91cfbf934f2 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/bc340a78606e498db678b91cfbf934f2 2023-02-11 15:03:17,300 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/42878969793341b49f5c15e9a393725c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,302 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/.tmp/f2/76f6eb0f3e4d4f18900021ea3529a69a as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/76f6eb0f3e4d4f18900021ea3529a69a 2023-02-11 15:03:17,305 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/bc340a78606e498db678b91cfbf934f2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,306 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/.tmp/f2/4f7ec7df06d2418c852eca754c55c0a4 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/4f7ec7df06d2418c852eca754c55c0a4 2023-02-11 15:03:17,309 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/76f6eb0f3e4d4f18900021ea3529a69a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,309 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f1/4522ad1184d84a43bafc2dcf32257fbf as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/4522ad1184d84a43bafc2dcf32257fbf 2023-02-11 15:03:17,310 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 817fd165fbba9985d4bc3d37a70e7c96 in 175ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,310 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 817fd165fbba9985d4bc3d37a70e7c96: 2023-02-11 15:03:17,310 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,310 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 15:03:17,315 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/4f7ec7df06d2418c852eca754c55c0a4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,317 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/4522ad1184d84a43bafc2dcf32257fbf, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:17,318 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cf319fb70658e28d441d56e493ccb6fc in 183ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,318 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf319fb70658e28d441d56e493ccb6fc: 2023-02-11 15:03:17,318 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,318 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 15:03:17,318 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/.tmp/f2/d00516a7d61443d39808e4fc3a30d886 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/d00516a7d61443d39808e4fc3a30d886 2023-02-11 15:03:17,318 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f1/4d5d197b9b8844c6ada909ac231f7cee as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/4d5d197b9b8844c6ada909ac231f7cee 2023-02-11 15:03:17,323 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/4d5d197b9b8844c6ada909ac231f7cee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,325 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/.tmp/f2/dda27dcd141440209a7cff0c6fd82072 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/dda27dcd141440209a7cff0c6fd82072 2023-02-11 15:03:17,332 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f1/1d800526828f4a3e903ae5354f0c5449 2023-02-11 15:03:17,335 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/d00516a7d61443d39808e4fc3a30d886, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:17,335 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/dda27dcd141440209a7cff0c6fd82072, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,336 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 93c48782c0080b931692516a8b1de449 in 207ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 93c48782c0080b931692516a8b1de449: 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:17,336 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 15:03:17,336 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ac89e902bd409aeb900a49780e6cd2f5 in 194ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. started... 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ac89e902bd409aeb900a49780e6cd2f5: 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0fd82b649be69b7a9389f268a9e5ea6b: 2023-02-11 15:03:17,336 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:17,336 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 15:03:17,336 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 15:03:17,348 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f2/1abb944a74a1480f94bdb50eabc86180 2023-02-11 15:03:17,355 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f1/1d800526828f4a3e903ae5354f0c5449 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/1d800526828f4a3e903ae5354f0c5449 2023-02-11 15:03:17,361 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/1d800526828f4a3e903ae5354f0c5449, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,362 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/.tmp/f2/1abb944a74a1480f94bdb50eabc86180 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/1abb944a74a1480f94bdb50eabc86180 2023-02-11 15:03:17,368 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/1abb944a74a1480f94bdb50eabc86180, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,369 INFO [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9ca200f280be5e80a4a0b8884c99d615 in 89ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,369 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9ca200f280be5e80a4a0b8884c99d615: 2023-02-11 15:03:17,370 DEBUG [rs(jenkins-hbase4.apache.org,44339,1676127793280)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,370 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 15:03:17,370 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 15:03:17,370 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,370 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 15:03:17,370 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44339,1676127793280' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 15:03:17,373 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,373 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:17,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:17,373 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,373 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:17,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:17,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:17,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:17,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44339,1676127793280' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 15:03:17,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d996a1[Count = 1] remaining members to acquire global barrier 2023-02-11 15:03:17,717 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f1/63b4bc0a44cc4415873b85c98d44f351 2023-02-11 15:03:17,734 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f2/acd9d8866a3b4d89bd4cd0dfd4967eb4 2023-02-11 15:03:17,740 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f1/63b4bc0a44cc4415873b85c98d44f351 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/63b4bc0a44cc4415873b85c98d44f351 2023-02-11 15:03:17,745 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/63b4bc0a44cc4415873b85c98d44f351, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,746 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/.tmp/f2/acd9d8866a3b4d89bd4cd0dfd4967eb4 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/acd9d8866a3b4d89bd4cd0dfd4967eb4 2023-02-11 15:03:17,751 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/acd9d8866a3b4d89bd4cd0dfd4967eb4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:17,752 INFO [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bfe77e996473d1b33b11d212e64750a9 in 484ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bfe77e996473d1b33b11d212e64750a9: 2023-02-11 15:03:17,752 DEBUG [rs(jenkins-hbase4.apache.org,46503,1676127793318)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,752 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 15:03:17,752 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 15:03:17,752 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,752 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 15:03:17,752 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46503,1676127793318' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 15:03:17,754 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,754 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:17,754 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,755 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:17,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46503,1676127793318' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 15:03:17,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d996a1[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:17,756 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 15:03:17,756 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 15:03:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 15:03:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 15:03:17,758 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 15:03:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44339,1676127793280' in zk 2023-02-11 15:03:17,758 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46503,1676127793318' in zk 2023-02-11 15:03:17,758 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,759 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:17,760 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 15:03:17,760 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,760 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:17,760 DEBUG [member: 'jenkins-hbase4.apache.org,44339,1676127793280' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 15:03:17,762 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 15:03:17,762 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:17,762 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:17,762 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1676127793318' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 15:03:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44339,1676127793280': 2023-02-11 15:03:17,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44339,1676127793280' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-11 15:03:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46503,1676127793318': 2023-02-11 15:03:17,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46503,1676127793318' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 15:03:17,768 INFO [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 15:03:17,768 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:17,768 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:17,768 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 15:03:17,768 INFO [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:17,770 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:17,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,770 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:17,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:17,771 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:17,772 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:17,773 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:17,773 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,776 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:17,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:17,777 DEBUG [(jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:17,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:17,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 15:03:17,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:17,777 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:17,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:17,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:17,778 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,778 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,778 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:17,778 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:17,778 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:17,779 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:17,879 DEBUG [Listener at localhost/33637] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:17,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41051] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:17,880 INFO [Listener at localhost/33637] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:17,881 DEBUG [Listener at localhost/33637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ecc4d24 to 127.0.0.1:64464 2023-02-11 15:03:17,881 DEBUG [Listener at localhost/33637] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:17,881 DEBUG [Listener at localhost/33637] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:17,882 DEBUG [Listener at localhost/33637] util.JVMClusterUtil(257): Found active master hash=1592520207, stopped=false 2023-02-11 15:03:17,882 INFO [Listener at localhost/33637] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:17,884 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:17,884 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:17,884 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:17,884 INFO [Listener at localhost/33637] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:17,884 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:17,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:17,887 DEBUG [Listener at localhost/33637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ec0ae87 to 127.0.0.1:64464 2023-02-11 15:03:17,887 DEBUG [Listener at localhost/33637] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:17,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:17,887 INFO [Listener at localhost/33637] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44339,1676127793280' ***** 2023-02-11 15:03:17,887 INFO [Listener at localhost/33637] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:17,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:17,887 INFO [Listener at localhost/33637] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46503,1676127793318' ***** 2023-02-11 15:03:17,887 INFO [Listener at localhost/33637] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:17,887 INFO [RS:0;jenkins-hbase4:44339] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:17,887 INFO [RS:1;jenkins-hbase4:46503] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:17,887 INFO [RS:0;jenkins-hbase4:44339] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:17,888 INFO [RS:1;jenkins-hbase4:46503] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:17,888 INFO [RS:0;jenkins-hbase4:44339] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:17,888 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:17,888 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:17,888 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:17,888 INFO [RS:1;jenkins-hbase4:46503] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:17,889 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:17,889 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:17,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 93c48782c0080b931692516a8b1de449, disabling compactions & flushes 2023-02-11 15:03:17,890 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:17,890 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:17,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,890 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:17,890 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:17,890 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:17,890 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for a1945f32b23894b48d5dcdf95850924f 2023-02-11 15:03:17,890 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:17,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 734d9a680881f9d7559efd10e093fc24, disabling compactions & flushes 2023-02-11 15:03:17,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. after waiting 0 ms 2023-02-11 15:03:17,890 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:17,890 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:17,890 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73b84a96 to 127.0.0.1:64464 2023-02-11 15:03:17,890 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:17,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,890 DEBUG [RS:0;jenkins-hbase4:44339] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d1cca47 to 127.0.0.1:64464 2023-02-11 15:03:17,890 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:17,891 DEBUG [RS:0;jenkins-hbase4:44339] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:17,891 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-11 15:03:17,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,891 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1479): Online Regions={734d9a680881f9d7559efd10e093fc24=testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24., 817fd165fbba9985d4bc3d37a70e7c96=testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96., f30072536f47d4a1465cf0f8579c3e7f=testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f., cf319fb70658e28d441d56e493ccb6fc=testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc., bfe77e996473d1b33b11d212e64750a9=testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.} 2023-02-11 15:03:17,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. after waiting 0 ms 2023-02-11 15:03:17,891 INFO [RS:0;jenkins-hbase4:44339] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:17,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,891 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1505): Waiting on 734d9a680881f9d7559efd10e093fc24, 817fd165fbba9985d4bc3d37a70e7c96, bfe77e996473d1b33b11d212e64750a9, cf319fb70658e28d441d56e493ccb6fc, f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:17,891 INFO [RS:0;jenkins-hbase4:44339] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:17,891 INFO [RS:0;jenkins-hbase4:44339] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:17,891 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:17,892 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-11 15:03:17,893 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:17,894 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1479): Online Regions={93c48782c0080b931692516a8b1de449=testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449., 4fd46c7a33b7ce6df81a694bff30024e=testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e., ac89e902bd409aeb900a49780e6cd2f5=testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5., 1588230740=hbase:meta,,1.1588230740, 9ca200f280be5e80a4a0b8884c99d615=testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615., a1945f32b23894b48d5dcdf95850924f=hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f., 0fd82b649be69b7a9389f268a9e5ea6b=testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.} 2023-02-11 15:03:17,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:17,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:17,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:17,895 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:17,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-11 15:03:17,897 DEBUG [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1505): Waiting on 0fd82b649be69b7a9389f268a9e5ea6b, 1588230740, 4fd46c7a33b7ce6df81a694bff30024e, 93c48782c0080b931692516a8b1de449, 9ca200f280be5e80a4a0b8884c99d615, a1945f32b23894b48d5dcdf95850924f, ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:17,898 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:17,899 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:17,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 15:03:17,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 734d9a680881f9d7559efd10e093fc24: Waiting for close lock at 1676127797890Running coprocessor pre-close hooks at 1676127797890Disabling compacts and flushes for region at 1676127797890Disabling writes for close at 1676127797891 (+1 ms)Writing region close event to WAL at 1676127797894 (+3 ms)Running coprocessor post-close hooks at 1676127797903 (+9 ms)Closed at 1676127797903 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 817fd165fbba9985d4bc3d37a70e7c96, disabling compactions & flushes 2023-02-11 15:03:17,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 93c48782c0080b931692516a8b1de449: Waiting for close lock at 1676127797890Running coprocessor pre-close hooks at 1676127797890Disabling compacts and flushes for region at 1676127797890Disabling writes for close at 1676127797890Writing region close event to WAL at 1676127797898 (+8 ms)Running coprocessor post-close hooks at 1676127797904 (+6 ms)Closed at 1676127797904 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. after waiting 0 ms 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:17,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fd46c7a33b7ce6df81a694bff30024e, disabling compactions & flushes 2023-02-11 15:03:17,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. after waiting 0 ms 2023-02-11 15:03:17,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 817fd165fbba9985d4bc3d37a70e7c96: Waiting for close lock at 1676127797904Running coprocessor pre-close hooks at 1676127797904Disabling compacts and flushes for region at 1676127797904Disabling writes for close at 1676127797904Writing region close event to WAL at 1676127797916 (+12 ms)Running coprocessor post-close hooks at 1676127797924 (+8 ms)Closed at 1676127797925 (+1 ms) 2023-02-11 15:03:17,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:17,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f30072536f47d4a1465cf0f8579c3e7f, disabling compactions & flushes 2023-02-11 15:03:17,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. after waiting 0 ms 2023-02-11 15:03:17,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/.tmp/info/a3b1c5724e6f4d28a7e5e862bda81bac 2023-02-11 15:03:17,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fd46c7a33b7ce6df81a694bff30024e: Waiting for close lock at 1676127797905Running coprocessor pre-close hooks at 1676127797905Disabling compacts and flushes for region at 1676127797905Disabling writes for close at 1676127797905Writing region close event to WAL at 1676127797915 (+10 ms)Running coprocessor post-close hooks at 1676127797925 (+10 ms)Closed at 1676127797926 (+1 ms) 2023-02-11 15:03:17,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:17,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ac89e902bd409aeb900a49780e6cd2f5, disabling compactions & flushes 2023-02-11 15:03:17,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. after waiting 0 ms 2023-02-11 15:03:17,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f30072536f47d4a1465cf0f8579c3e7f: Waiting for close lock at 1676127797925Running coprocessor pre-close hooks at 1676127797925Disabling compacts and flushes for region at 1676127797925Disabling writes for close at 1676127797925Writing region close event to WAL at 1676127797937 (+12 ms)Running coprocessor post-close hooks at 1676127797945 (+8 ms)Closed at 1676127797945 2023-02-11 15:03:17,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cf319fb70658e28d441d56e493ccb6fc, disabling compactions & flushes 2023-02-11 15:03:17,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. after waiting 0 ms 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ac89e902bd409aeb900a49780e6cd2f5: Waiting for close lock at 1676127797926Running coprocessor pre-close hooks at 1676127797926Disabling compacts and flushes for region at 1676127797926Disabling writes for close at 1676127797930 (+4 ms)Writing region close event to WAL at 1676127797938 (+8 ms)Running coprocessor post-close hooks at 1676127797946 (+8 ms)Closed at 1676127797946 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9ca200f280be5e80a4a0b8884c99d615, disabling compactions & flushes 2023-02-11 15:03:17,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. after waiting 0 ms 2023-02-11 15:03:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/.tmp/table/e06bf434c3be4aa8974468259197a427 2023-02-11 15:03:17,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9ca200f280be5e80a4a0b8884c99d615: Waiting for close lock at 1676127797946Running coprocessor pre-close hooks at 1676127797946Disabling compacts and flushes for region at 1676127797946Disabling writes for close at 1676127797946Writing region close event to WAL at 1676127797952 (+6 ms)Running coprocessor post-close hooks at 1676127797956 (+4 ms)Closed at 1676127797956 2023-02-11 15:03:17,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:17,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a1945f32b23894b48d5dcdf95850924f, disabling compactions & flushes 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cf319fb70658e28d441d56e493ccb6fc: Waiting for close lock at 1676127797946Running coprocessor pre-close hooks at 1676127797946Disabling compacts and flushes for region at 1676127797946Disabling writes for close at 1676127797946Writing region close event to WAL at 1676127797952 (+6 ms)Running coprocessor post-close hooks at 1676127797956 (+4 ms)Closed at 1676127797958 (+2 ms) 2023-02-11 15:03:17,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bfe77e996473d1b33b11d212e64750a9, disabling compactions & flushes 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. after waiting 0 ms 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:17,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a1945f32b23894b48d5dcdf95850924f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:17,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. after waiting 0 ms 2023-02-11 15:03:17,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/.tmp/info/a3b1c5724e6f4d28a7e5e862bda81bac as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/info/a3b1c5724e6f4d28a7e5e862bda81bac 2023-02-11 15:03:17,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:17,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bfe77e996473d1b33b11d212e64750a9: Waiting for close lock at 1676127797958Running coprocessor pre-close hooks at 1676127797958Disabling compacts and flushes for region at 1676127797958Disabling writes for close at 1676127797959 (+1 ms)Writing region close event to WAL at 1676127797960 (+1 ms)Running coprocessor post-close hooks at 1676127797964 (+4 ms)Closed at 1676127797964 2023-02-11 15:03:17,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:17,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/.tmp/info/de3f392d9bdc40bfbd0e29ac4d90eff8 2023-02-11 15:03:17,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/info/a3b1c5724e6f4d28a7e5e862bda81bac, entries=110, sequenceid=32, filesize=18.7 K 2023-02-11 15:03:17,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/.tmp/table/e06bf434c3be4aa8974468259197a427 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/table/e06bf434c3be4aa8974468259197a427 2023-02-11 15:03:17,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/.tmp/info/de3f392d9bdc40bfbd0e29ac4d90eff8 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/info/de3f392d9bdc40bfbd0e29ac4d90eff8 2023-02-11 15:03:17,974 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/table/e06bf434c3be4aa8974468259197a427, entries=4, sequenceid=32, filesize=4.8 K 2023-02-11 15:03:17,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=32, compaction requested=false 2023-02-11 15:03:17,976 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 15:03:17,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/info/de3f392d9bdc40bfbd0e29ac4d90eff8, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:17,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a1945f32b23894b48d5dcdf95850924f in 21ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:17,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 15:03:17,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-11 15:03:17,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:17,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:17,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/hbase/namespace/a1945f32b23894b48d5dcdf95850924f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:17,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127797893Running coprocessor pre-close hooks at 1676127797893Disabling compacts and flushes for region at 1676127797893Disabling writes for close at 1676127797895 (+2 ms)Obtaining lock to block concurrent updates at 1676127797895Preparing flush snapshotting stores in 1588230740 at 1676127797895Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676127797897 (+2 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676127797898 (+1 ms)Flushing 1588230740/info: creating writer at 1676127797898Flushing 1588230740/info: appending metadata at 1676127797903 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676127797903Flushing 1588230740/table: creating writer at 1676127797941 (+38 ms)Flushing 1588230740/table: appending metadata at 1676127797944 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676127797944Flushing 1588230740/info: reopening flushed file at 1676127797964 (+20 ms)Flushing 1588230740/table: reopening flushed file at 1676127797969 (+5 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=32, compaction requested=false at 1676127797976 (+7 ms)Writing region close event to WAL at 1676127797977 (+1 ms)Running coprocessor post-close hooks at 1676127797984 (+7 ms)Closed at 1676127797984 2023-02-11 15:03:17,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:17,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:17,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a1945f32b23894b48d5dcdf95850924f: Waiting for close lock at 1676127797958Running coprocessor pre-close hooks at 1676127797958Disabling compacts and flushes for region at 1676127797958Disabling writes for close at 1676127797958Obtaining lock to block concurrent updates at 1676127797958Preparing flush snapshotting stores in a1945f32b23894b48d5dcdf95850924f at 1676127797958Finished memstore snapshotting hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127797959 (+1 ms)Flushing stores of hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. at 1676127797959Flushing a1945f32b23894b48d5dcdf95850924f/info: creating writer at 1676127797959Flushing a1945f32b23894b48d5dcdf95850924f/info: appending metadata at 1676127797962 (+3 ms)Flushing a1945f32b23894b48d5dcdf95850924f/info: closing flushed file at 1676127797962Flushing a1945f32b23894b48d5dcdf95850924f/info: reopening flushed file at 1676127797972 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a1945f32b23894b48d5dcdf95850924f in 21ms, sequenceid=6, compaction requested=false at 1676127797979 (+7 ms)Writing region close event to WAL at 1676127797980 (+1 ms)Running coprocessor post-close hooks at 1676127797985 (+5 ms)Closed at 1676127797985 2023-02-11 15:03:17,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127794021.a1945f32b23894b48d5dcdf95850924f. 2023-02-11 15:03:17,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0fd82b649be69b7a9389f268a9e5ea6b, disabling compactions & flushes 2023-02-11 15:03:17,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:17,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:17,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. after waiting 0 ms 2023-02-11 15:03:17,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:17,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 15:03:17,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:17,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0fd82b649be69b7a9389f268a9e5ea6b: Waiting for close lock at 1676127797985Running coprocessor pre-close hooks at 1676127797985Disabling compacts and flushes for region at 1676127797985Disabling writes for close at 1676127797986 (+1 ms)Writing region close event to WAL at 1676127797986Running coprocessor post-close hooks at 1676127797989 (+3 ms)Closed at 1676127797989 2023-02-11 15:03:17,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:18,091 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46503,1676127793318; all regions closed. 2023-02-11 15:03:18,097 DEBUG [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/oldWALs 2023-02-11 15:03:18,097 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46503%2C1676127793318:(num 1676127794764) 2023-02-11 15:03:18,097 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:18,097 INFO [RS:1;jenkins-hbase4:46503] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:18,097 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44339,1676127793280; all regions closed. 2023-02-11 15:03:18,097 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:18,097 INFO [RS:1;jenkins-hbase4:46503] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:18,097 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:18,097 INFO [RS:1;jenkins-hbase4:46503] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:18,097 INFO [RS:1;jenkins-hbase4:46503] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:18,098 INFO [RS:1;jenkins-hbase4:46503] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46503 2023-02-11 15:03:18,104 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:18,104 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:18,104 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ff9dd19 rejected from java.util.concurrent.ThreadPoolExecutor@5bc6423e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,104 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:18,104 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e10e9ed rejected from java.util.concurrent.ThreadPoolExecutor@5bc6423e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,105 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46503,1676127793318 2023-02-11 15:03:18,105 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:18,105 DEBUG [RS:0;jenkins-hbase4:44339] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/oldWALs 2023-02-11 15:03:18,105 INFO [RS:0;jenkins-hbase4:44339] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44339%2C1676127793280.meta:.meta(num 1676127793936) 2023-02-11 15:03:18,106 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46503,1676127793318] 2023-02-11 15:03:18,106 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46503,1676127793318; numProcessing=1 2023-02-11 15:03:18,108 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46503,1676127793318 already deleted, retry=false 2023-02-11 15:03:18,108 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46503,1676127793318 expired; onlineServers=1 2023-02-11 15:03:18,112 DEBUG [RS:0;jenkins-hbase4:44339] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/oldWALs 2023-02-11 15:03:18,112 INFO [RS:0;jenkins-hbase4:44339] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44339%2C1676127793280:(num 1676127794386) 2023-02-11 15:03:18,112 DEBUG [RS:0;jenkins-hbase4:44339] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:18,112 INFO [RS:0;jenkins-hbase4:44339] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:18,112 INFO [RS:0;jenkins-hbase4:44339] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:18,112 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:18,113 INFO [RS:0;jenkins-hbase4:44339] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44339 2023-02-11 15:03:18,116 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44339,1676127793280 2023-02-11 15:03:18,116 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:18,116 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68cf7d57 rejected from java.util.concurrent.ThreadPoolExecutor@6cf0f496[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,118 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44339,1676127793280] 2023-02-11 15:03:18,118 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44339,1676127793280; numProcessing=2 2023-02-11 15:03:18,119 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44339,1676127793280 already deleted, retry=false 2023-02-11 15:03:18,119 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44339,1676127793280 expired; onlineServers=0 2023-02-11 15:03:18,119 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41051,1676127793183' ***** 2023-02-11 15:03:18,119 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:18,120 DEBUG [M:0;jenkins-hbase4:41051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fd6e434, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:18,121 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41051,1676127793183 2023-02-11 15:03:18,121 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41051,1676127793183; all regions closed. 2023-02-11 15:03:18,121 DEBUG [M:0;jenkins-hbase4:41051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:18,121 DEBUG [M:0;jenkins-hbase4:41051] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:18,121 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:18,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127793565] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127793565,5,FailOnTimeoutGroup] 2023-02-11 15:03:18,121 DEBUG [M:0;jenkins-hbase4:41051] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:18,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127793565] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127793565,5,FailOnTimeoutGroup] 2023-02-11 15:03:18,123 INFO [M:0;jenkins-hbase4:41051] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:18,123 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:18,123 INFO [M:0;jenkins-hbase4:41051] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:18,123 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:18,123 INFO [M:0;jenkins-hbase4:41051] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:18,123 DEBUG [M:0;jenkins-hbase4:41051] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:18,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:18,123 INFO [M:0;jenkins-hbase4:41051] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:18,124 ERROR [M:0;jenkins-hbase4:41051] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 15:03:18,124 INFO [M:0;jenkins-hbase4:41051] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:18,124 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:18,125 DEBUG [M:0;jenkins-hbase4:41051] zookeeper.ZKUtil(398): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:18,125 WARN [M:0;jenkins-hbase4:41051] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:18,125 INFO [M:0;jenkins-hbase4:41051] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:18,125 INFO [M:0;jenkins-hbase4:41051] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:18,125 DEBUG [M:0;jenkins-hbase4:41051] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:18,125 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:18,125 DEBUG [M:0;jenkins-hbase4:41051] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:18,125 DEBUG [M:0;jenkins-hbase4:41051] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:18,125 DEBUG [M:0;jenkins-hbase4:41051] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:18,126 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-11 15:03:18,139 INFO [M:0;jenkins-hbase4:41051] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3710aca29ff54dc28c03ad6c93638af8 2023-02-11 15:03:18,144 DEBUG [M:0;jenkins-hbase4:41051] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3710aca29ff54dc28c03ad6c93638af8 as hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3710aca29ff54dc28c03ad6c93638af8 2023-02-11 15:03:18,149 INFO [M:0;jenkins-hbase4:41051] regionserver.HStore(1080): Added hdfs://localhost:33135/user/jenkins/test-data/4eaaa3b0-4985-48a2-0dc0-22aa0ac5b80a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3710aca29ff54dc28c03ad6c93638af8, entries=31, sequenceid=218, filesize=9.0 K 2023-02-11 15:03:18,150 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=218, compaction requested=false 2023-02-11 15:03:18,151 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:18,151 DEBUG [M:0;jenkins-hbase4:41051] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127798125Disabling compacts and flushes for region at 1676127798125Disabling writes for close at 1676127798125Obtaining lock to block concurrent updates at 1676127798126 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127798126Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676127798126Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127798127 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127798127Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127798130 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127798130Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127798145 (+15 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=218, compaction requested=false at 1676127798150 (+5 ms)Writing region close event to WAL at 1676127798151 (+1 ms)Closed at 1676127798151 2023-02-11 15:03:18,156 INFO [M:0;jenkins-hbase4:41051] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:18,156 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:18,156 INFO [M:0;jenkins-hbase4:41051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41051 2023-02-11 15:03:18,159 DEBUG [M:0;jenkins-hbase4:41051] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41051,1676127793183 already deleted, retry=false 2023-02-11 15:03:18,386 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:18,386 INFO [M:0;jenkins-hbase4:41051] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41051,1676127793183; zookeeper connection closed. 2023-02-11 15:03:18,386 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55177524 rejected from java.util.concurrent.ThreadPoolExecutor@5128eb5e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,387 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): master:41051-0x10043e859c60000, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:18,387 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b244c44 rejected from java.util.concurrent.ThreadPoolExecutor@5128eb5e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,486 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:18,486 INFO [RS:0;jenkins-hbase4:44339] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44339,1676127793280; zookeeper connection closed. 2023-02-11 15:03:18,486 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ba72a1b rejected from java.util.concurrent.ThreadPoolExecutor@6cf0f496[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,486 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:44339-0x10043e859c60001, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:18,486 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2510de81] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2510de81 2023-02-11 15:03:18,487 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@732ed83d rejected from java.util.concurrent.ThreadPoolExecutor@6cf0f496[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,586 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:18,586 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46503,1676127793318; zookeeper connection closed. 2023-02-11 15:03:18,586 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@462e8a4d rejected from java.util.concurrent.ThreadPoolExecutor@5bc6423e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,587 DEBUG [Listener at localhost/33637-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x10043e859c60002, quorum=127.0.0.1:64464, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:18,587 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@43b50426] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@43b50426 2023-02-11 15:03:18,587 ERROR [Listener at localhost/33637-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@470df9dc rejected from java.util.concurrent.ThreadPoolExecutor@5bc6423e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:18,587 INFO [Listener at localhost/33637] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:18,673 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop-3903005526187567228.jar 2023-02-11 15:03:18,677 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676127795507 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:18,677 DEBUG [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:18,678 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(239): region to add: 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=734d9a680881f9d7559efd10e093fc24 as 734d9a680881f9d7559efd10e093fc24 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=817fd165fbba9985d4bc3d37a70e7c96 as 817fd165fbba9985d4bc3d37a70e7c96 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=93c48782c0080b931692516a8b1de449 as 93c48782c0080b931692516a8b1de449 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=4fd46c7a33b7ce6df81a694bff30024e as 4fd46c7a33b7ce6df81a694bff30024e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=ac89e902bd409aeb900a49780e6cd2f5 as ac89e902bd409aeb900a49780e6cd2f5 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=f30072536f47d4a1465cf0f8579c3e7f as f30072536f47d4a1465cf0f8579c3e7f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=9ca200f280be5e80a4a0b8884c99d615 as 9ca200f280be5e80a4a0b8884c99d615 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=cf319fb70658e28d441d56e493ccb6fc as cf319fb70658e28d441d56e493ccb6fc in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=bfe77e996473d1b33b11d212e64750a9 as bfe77e996473d1b33b11d212e64750a9 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,679 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(585): clone region=0fd82b649be69b7a9389f268a9e5ea6b as 0fd82b649be69b7a9389f268a9e5ea6b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-11 15:03:18,680 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 734d9a680881f9d7559efd10e093fc24, NAME => 'testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,683 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => cf319fb70658e28d441d56e493ccb6fc, NAME => 'testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,683 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 817fd165fbba9985d4bc3d37a70e7c96, NAME => 'testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,683 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 9ca200f280be5e80a4a0b8884c99d615, NAME => 'testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,684 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ac89e902bd409aeb900a49780e6cd2f5, NAME => 'testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,684 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 4fd46c7a33b7ce6df81a694bff30024e, NAME => 'testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,684 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 93c48782c0080b931692516a8b1de449, NAME => 'testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,684 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => f30072536f47d4a1465cf0f8579c3e7f, NAME => 'testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,704 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,705 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 734d9a680881f9d7559efd10e093fc24, disabling compactions & flushes 2023-02-11 15:03:18,705 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:18,705 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:18,705 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. after waiting 0 ms 2023-02-11 15:03:18,705 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:18,705 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:18,705 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 734d9a680881f9d7559efd10e093fc24: Waiting for close lock at 1676127798705Disabling compacts and flushes for region at 1676127798705Disabling writes for close at 1676127798705Writing region close event to WAL at 1676127798705Closed at 1676127798705 2023-02-11 15:03:18,705 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bfe77e996473d1b33b11d212e64750a9, NAME => 'testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,725 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,725 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 71ce5132603f4fe0b90959865ace3021 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,725 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,725 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 762c7d551207481fa575fd504cfb7279 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,727 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,727 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8face590ab7242fdb6eaccd4654509c3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,732 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,732 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8af158a992014e97bbee8513fbc6a8ac from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,735 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,735 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 69870b3d1c32411291cc131eedef479e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,736 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c64c2d1769a7441193cda2b9bdbd114d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,736 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c3adb43e8fb34bbfad967a69bba45d6a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,737 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 50e3386b7f4645ce980bf14cce8e99fa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,737 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c86623944239417f972b8bff806c0afb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,741 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,741 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 89c08749c09f4e2192f576217acdab69 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,742 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,742 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 16fe43b1a6be489ebf7d85c7dd34c363 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,745 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 058628f0c5df4ed6995eb829d165011b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,745 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 4fd46c7a33b7ce6df81a694bff30024e, disabling compactions & flushes 2023-02-11 15:03:18,745 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ac89e902bd409aeb900a49780e6cd2f5, disabling compactions & flushes 2023-02-11 15:03:18,745 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 9ca200f280be5e80a4a0b8884c99d615, disabling compactions & flushes 2023-02-11 15:03:18,745 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:18,745 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:18,745 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:18,745 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. after waiting 0 ms 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:18,746 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ac89e902bd409aeb900a49780e6cd2f5: Waiting for close lock at 1676127798745Disabling compacts and flushes for region at 1676127798745Disabling writes for close at 1676127798746 (+1 ms)Writing region close event to WAL at 1676127798746Closed at 1676127798746 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 817fd165fbba9985d4bc3d37a70e7c96, disabling compactions & flushes 2023-02-11 15:03:18,746 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:18,746 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 0fd82b649be69b7a9389f268a9e5ea6b, NAME => 'testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:18,745 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. after waiting 0 ms 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. after waiting 0 ms 2023-02-11 15:03:18,746 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7e73a432a0b440e89afdb4902ceaf617 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:18,746 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. after waiting 0 ms 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:18,747 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:18,747 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 4fd46c7a33b7ce6df81a694bff30024e: Waiting for close lock at 1676127798745Disabling compacts and flushes for region at 1676127798745Disabling writes for close at 1676127798747 (+2 ms)Writing region close event to WAL at 1676127798747Closed at 1676127798747 2023-02-11 15:03:18,747 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 9ca200f280be5e80a4a0b8884c99d615: Waiting for close lock at 1676127798745Disabling compacts and flushes for region at 1676127798745Disabling writes for close at 1676127798747 (+2 ms)Writing region close event to WAL at 1676127798747Closed at 1676127798747 2023-02-11 15:03:18,747 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b20cefee632461f8233cc22857b4f9a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:18,747 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:18,748 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 817fd165fbba9985d4bc3d37a70e7c96: Waiting for close lock at 1676127798746Disabling compacts and flushes for region at 1676127798746Disabling writes for close at 1676127798747 (+1 ms)Writing region close event to WAL at 1676127798747Closed at 1676127798747 2023-02-11 15:03:18,749 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing cf319fb70658e28d441d56e493ccb6fc, disabling compactions & flushes 2023-02-11 15:03:18,749 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:18,749 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:18,749 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. after waiting 0 ms 2023-02-11 15:03:18,749 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:18,749 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:18,749 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for cf319fb70658e28d441d56e493ccb6fc: Waiting for close lock at 1676127798749Disabling compacts and flushes for region at 1676127798749Disabling writes for close at 1676127798749Writing region close event to WAL at 1676127798749Closed at 1676127798749 2023-02-11 15:03:18,750 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bfe77e996473d1b33b11d212e64750a9, disabling compactions & flushes 2023-02-11 15:03:18,750 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:18,750 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:18,750 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. after waiting 0 ms 2023-02-11 15:03:18,750 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:18,750 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:18,750 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bfe77e996473d1b33b11d212e64750a9: Waiting for close lock at 1676127798750Disabling compacts and flushes for region at 1676127798750Disabling writes for close at 1676127798750Writing region close event to WAL at 1676127798750Closed at 1676127798750 2023-02-11 15:03:18,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 93c48782c0080b931692516a8b1de449, disabling compactions & flushes 2023-02-11 15:03:18,751 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:18,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:18,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. after waiting 0 ms 2023-02-11 15:03:18,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:18,751 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:18,751 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 93c48782c0080b931692516a8b1de449: Waiting for close lock at 1676127798751Disabling compacts and flushes for region at 1676127798751Disabling writes for close at 1676127798751Writing region close event to WAL at 1676127798751Closed at 1676127798751 2023-02-11 15:03:18,757 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:18,757 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 0fd82b649be69b7a9389f268a9e5ea6b, disabling compactions & flushes 2023-02-11 15:03:18,757 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:18,757 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:18,757 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. after waiting 0 ms 2023-02-11 15:03:18,757 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:18,757 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:18,757 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 0fd82b649be69b7a9389f268a9e5ea6b: Waiting for close lock at 1676127798757Disabling compacts and flushes for region at 1676127798757Disabling writes for close at 1676127798757Writing region close event to WAL at 1676127798757Closed at 1676127798757 2023-02-11 15:03:19,115 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:19,115 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1cb15348fba41e7974c9a8069ddd03a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:19,118 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33f71c6e1f4e49d49915953fb6024a4e from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-11 15:03:19,120 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing f30072536f47d4a1465cf0f8579c3e7f, disabling compactions & flushes 2023-02-11 15:03:19,120 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:19,120 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:19,120 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. after waiting 0 ms 2023-02-11 15:03:19,120 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:19,120 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:19,121 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for f30072536f47d4a1465cf0f8579c3e7f: Waiting for close lock at 1676127799120Disabling compacts and flushes for region at 1676127799120Disabling writes for close at 1676127799120Writing region close event to WAL at 1676127799120Closed at 1676127799120 2023-02-11 15:03:19,121 INFO [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676127795507 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:19,121 DEBUG [Listener at localhost/33637] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:19,121 DEBUG [Listener at localhost/33637] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a 2023-02-11 15:03:19,122 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:19,122 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:19,123 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 15:03:19,123 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------0fd82b649be69b7a9389f268a9e5ea6b/ 2023-02-11 15:03:19,124 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,124 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------4fd46c7a33b7ce6df81a694bff30024e/ 2023-02-11 15:03:19,124 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,124 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,125 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=4fd46c7a33b7ce6df81a694bff30024e-8af158a992014e97bbee8513fbc6a8ac 2023-02-11 15:03:19,125 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,125 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=4fd46c7a33b7ce6df81a694bff30024e-c64c2d1769a7441193cda2b9bdbd114d 2023-02-11 15:03:19,125 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------734d9a680881f9d7559efd10e093fc24/ 2023-02-11 15:03:19,126 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,126 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------817fd165fbba9985d4bc3d37a70e7c96/ 2023-02-11 15:03:19,126 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,126 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,127 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=817fd165fbba9985d4bc3d37a70e7c96-762c7d551207481fa575fd504cfb7279 2023-02-11 15:03:19,127 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,127 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=817fd165fbba9985d4bc3d37a70e7c96-c3adb43e8fb34bbfad967a69bba45d6a 2023-02-11 15:03:19,127 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------93c48782c0080b931692516a8b1de449/ 2023-02-11 15:03:19,128 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,128 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,128 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=93c48782c0080b931692516a8b1de449-16fe43b1a6be489ebf7d85c7dd34c363 2023-02-11 15:03:19,128 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,129 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=93c48782c0080b931692516a8b1de449-1b20cefee632461f8233cc22857b4f9a 2023-02-11 15:03:19,129 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------9ca200f280be5e80a4a0b8884c99d615/ 2023-02-11 15:03:19,129 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,129 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,129 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=9ca200f280be5e80a4a0b8884c99d615-8face590ab7242fdb6eaccd4654509c3 2023-02-11 15:03:19,129 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,130 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=9ca200f280be5e80a4a0b8884c99d615-50e3386b7f4645ce980bf14cce8e99fa 2023-02-11 15:03:19,130 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------ac89e902bd409aeb900a49780e6cd2f5/ 2023-02-11 15:03:19,130 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,130 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,131 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=ac89e902bd409aeb900a49780e6cd2f5-71ce5132603f4fe0b90959865ace3021 2023-02-11 15:03:19,131 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,131 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=ac89e902bd409aeb900a49780e6cd2f5-c86623944239417f972b8bff806c0afb 2023-02-11 15:03:19,131 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------bfe77e996473d1b33b11d212e64750a9/ 2023-02-11 15:03:19,132 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,132 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,132 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=bfe77e996473d1b33b11d212e64750a9-89c08749c09f4e2192f576217acdab69 2023-02-11 15:03:19,132 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,133 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=bfe77e996473d1b33b11d212e64750a9-7e73a432a0b440e89afdb4902ceaf617 2023-02-11 15:03:19,133 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------cf319fb70658e28d441d56e493ccb6fc/ 2023-02-11 15:03:19,133 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,133 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,134 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=cf319fb70658e28d441d56e493ccb6fc-69870b3d1c32411291cc131eedef479e 2023-02-11 15:03:19,134 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,134 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=cf319fb70658e28d441d56e493ccb6fc-058628f0c5df4ed6995eb829d165011b 2023-02-11 15:03:19,134 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |----------f30072536f47d4a1465cf0f8579c3e7f/ 2023-02-11 15:03:19,134 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:19,134 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:19,135 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=f30072536f47d4a1465cf0f8579c3e7f-f1cb15348fba41e7974c9a8069ddd03a 2023-02-11 15:03:19,135 DEBUG [Listener at localhost/33637] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:19,135 DEBUG [Listener at localhost/33637] util.CommonFSUtils(702): |----------------testWithMapReduce=f30072536f47d4a1465cf0f8579c3e7f-33f71c6e1f4e49d49915953fb6024a4e 2023-02-11 15:03:19,136 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:19,136 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:19,137 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:19,137 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,055 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop-8920805592287084054.jar 2023-02-11 15:03:20,055 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,055 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,121 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop-4234671013740831904.jar 2023-02-11 15:03:20,121 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,122 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,122 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,122 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,123 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,123 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,123 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 15:03:20,124 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 15:03:20,124 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 15:03:20,125 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 15:03:20,125 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 15:03:20,125 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 15:03:20,126 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 15:03:20,126 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 15:03:20,126 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 15:03:20,127 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 15:03:20,127 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:20,128 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:20,128 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:20,129 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:20,129 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 15:03:20,194 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop-4966690014062650803.jar 2023-02-11 15:03:20,195 DEBUG [Listener at localhost/33637] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 15:03:20,200 WARN [Listener at localhost/33637] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 15:03:20,206 WARN [Listener at localhost/33637] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-11 15:03:20,212 INFO [Listener at localhost/33637] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 15:03:20,313 WARN [Listener at localhost/33637] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/mapreduce.cluster.local.dir/1676127800281/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 15:03:20,313 WARN [Listener at localhost/33637] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/mapreduce.cluster.local.dir/1676127800281/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 15:03:20,347 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,347 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,348 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,350 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:20,351 DEBUG [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/f1 2023-02-11 15:03:20,352 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fd82b649be69b7a9389f268a9e5ea6b columnFamilyName f1 2023-02-11 15:03:20,352 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(310): Store=0fd82b649be69b7a9389f268a9e5ea6b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,353 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0fd82b649be69b7a9389f268a9e5ea6b 2023-02-11 15:03:20,354 DEBUG [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/0fd82b649be69b7a9389f268a9e5ea6b/f2 2023-02-11 15:03:20,354 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fd82b649be69b7a9389f268a9e5ea6b columnFamilyName f2 2023-02-11 15:03:20,355 INFO [StoreOpener-0fd82b649be69b7a9389f268a9e5ea6b-1] regionserver.HStore(310): Store=0fd82b649be69b7a9389f268a9e5ea6b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,355 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0fd82b649be69b7a9389f268a9e5ea6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72365267, jitterRate=0.0783265084028244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0fd82b649be69b7a9389f268a9e5ea6b: Writing region info on filesystem at 1676127800348Initializing all the Stores at 1676127800349 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800349Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800349Region opened successfully at 1676127800355 (+6 ms) 2023-02-11 15:03:20,372 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0fd82b649be69b7a9389f268a9e5ea6b, disabling compactions & flushes 2023-02-11 15:03:20,372 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:20,372 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:20,372 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. after waiting 0 ms 2023-02-11 15:03:20,372 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:20,373 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676127794667.0fd82b649be69b7a9389f268a9e5ea6b. 2023-02-11 15:03:20,373 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0fd82b649be69b7a9389f268a9e5ea6b: Waiting for close lock at 1676127800372Disabling compacts and flushes for region at 1676127800372Disabling writes for close at 1676127800372Writing region close event to WAL at 1676127800373 (+1 ms)Closed at 1676127800373 2023-02-11 15:03:20,376 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,376 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,377 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,379 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:20,380 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1 2023-02-11 15:03:20,381 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817fd165fbba9985d4bc3d37a70e7c96 columnFamilyName f1 2023-02-11 15:03:20,386 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f1/testWithMapReduce=817fd165fbba9985d4bc3d37a70e7c96-762c7d551207481fa575fd504cfb7279 2023-02-11 15:03:20,386 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(310): Store=817fd165fbba9985d4bc3d37a70e7c96/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,386 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 817fd165fbba9985d4bc3d37a70e7c96 2023-02-11 15:03:20,387 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2 2023-02-11 15:03:20,387 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817fd165fbba9985d4bc3d37a70e7c96 columnFamilyName f2 2023-02-11 15:03:20,392 DEBUG [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/817fd165fbba9985d4bc3d37a70e7c96/f2/testWithMapReduce=817fd165fbba9985d4bc3d37a70e7c96-c3adb43e8fb34bbfad967a69bba45d6a 2023-02-11 15:03:20,392 INFO [StoreOpener-817fd165fbba9985d4bc3d37a70e7c96-1] regionserver.HStore(310): Store=817fd165fbba9985d4bc3d37a70e7c96/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,392 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 817fd165fbba9985d4bc3d37a70e7c96; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68875480, jitterRate=0.02632462978363037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 817fd165fbba9985d4bc3d37a70e7c96: Writing region info on filesystem at 1676127800378Initializing all the Stores at 1676127800378Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800378Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800379 (+1 ms)Region opened successfully at 1676127800392 (+13 ms) 2023-02-11 15:03:20,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 817fd165fbba9985d4bc3d37a70e7c96, disabling compactions & flushes 2023-02-11 15:03:20,432 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:20,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:20,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. after waiting 0 ms 2023-02-11 15:03:20,432 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:20,439 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676127794667.817fd165fbba9985d4bc3d37a70e7c96. 2023-02-11 15:03:20,439 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 817fd165fbba9985d4bc3d37a70e7c96: Waiting for close lock at 1676127800432Disabling compacts and flushes for region at 1676127800432Disabling writes for close at 1676127800432Writing region close event to WAL at 1676127800439 (+7 ms)Closed at 1676127800439 2023-02-11 15:03:20,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,442 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,443 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,445 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:20,446 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1 2023-02-11 15:03:20,446 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfe77e996473d1b33b11d212e64750a9 columnFamilyName f1 2023-02-11 15:03:20,450 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f1/testWithMapReduce=bfe77e996473d1b33b11d212e64750a9-89c08749c09f4e2192f576217acdab69 2023-02-11 15:03:20,451 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(310): Store=bfe77e996473d1b33b11d212e64750a9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,451 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bfe77e996473d1b33b11d212e64750a9 2023-02-11 15:03:20,452 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2 2023-02-11 15:03:20,452 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bfe77e996473d1b33b11d212e64750a9 columnFamilyName f2 2023-02-11 15:03:20,458 DEBUG [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/bfe77e996473d1b33b11d212e64750a9/f2/testWithMapReduce=bfe77e996473d1b33b11d212e64750a9-7e73a432a0b440e89afdb4902ceaf617 2023-02-11 15:03:20,459 INFO [StoreOpener-bfe77e996473d1b33b11d212e64750a9-1] regionserver.HStore(310): Store=bfe77e996473d1b33b11d212e64750a9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,459 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bfe77e996473d1b33b11d212e64750a9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69200603, jitterRate=0.031169340014457703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bfe77e996473d1b33b11d212e64750a9: Writing region info on filesystem at 1676127800443Initializing all the Stores at 1676127800444 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800444Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800444Region opened successfully at 1676127800459 (+15 ms) 2023-02-11 15:03:20,496 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bfe77e996473d1b33b11d212e64750a9, disabling compactions & flushes 2023-02-11 15:03:20,497 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:20,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:20,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. after waiting 0 ms 2023-02-11 15:03:20,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:20,498 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676127794667.bfe77e996473d1b33b11d212e64750a9. 2023-02-11 15:03:20,498 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bfe77e996473d1b33b11d212e64750a9: Waiting for close lock at 1676127800496Disabling compacts and flushes for region at 1676127800496Disabling writes for close at 1676127800497 (+1 ms)Writing region close event to WAL at 1676127800498 (+1 ms)Closed at 1676127800498 2023-02-11 15:03:20,501 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,501 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,504 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,506 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:20,507 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1 2023-02-11 15:03:20,507 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd46c7a33b7ce6df81a694bff30024e columnFamilyName f1 2023-02-11 15:03:20,512 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f1/testWithMapReduce=4fd46c7a33b7ce6df81a694bff30024e-8af158a992014e97bbee8513fbc6a8ac 2023-02-11 15:03:20,512 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(310): Store=4fd46c7a33b7ce6df81a694bff30024e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,512 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fd46c7a33b7ce6df81a694bff30024e 2023-02-11 15:03:20,513 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2 2023-02-11 15:03:20,513 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd46c7a33b7ce6df81a694bff30024e columnFamilyName f2 2023-02-11 15:03:20,519 DEBUG [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/4fd46c7a33b7ce6df81a694bff30024e/f2/testWithMapReduce=4fd46c7a33b7ce6df81a694bff30024e-c64c2d1769a7441193cda2b9bdbd114d 2023-02-11 15:03:20,519 INFO [StoreOpener-4fd46c7a33b7ce6df81a694bff30024e-1] regionserver.HStore(310): Store=4fd46c7a33b7ce6df81a694bff30024e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,520 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,520 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4fd46c7a33b7ce6df81a694bff30024e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68161565, jitterRate=0.01568646728992462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,520 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4fd46c7a33b7ce6df81a694bff30024e: Writing region info on filesystem at 1676127800504Initializing all the Stores at 1676127800505 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800505Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800506 (+1 ms)Region opened successfully at 1676127800520 (+14 ms) 2023-02-11 15:03:20,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4fd46c7a33b7ce6df81a694bff30024e, disabling compactions & flushes 2023-02-11 15:03:20,563 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:20,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:20,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. after waiting 0 ms 2023-02-11 15:03:20,563 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:20,564 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676127794667.4fd46c7a33b7ce6df81a694bff30024e. 2023-02-11 15:03:20,564 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4fd46c7a33b7ce6df81a694bff30024e: Waiting for close lock at 1676127800563Disabling compacts and flushes for region at 1676127800563Disabling writes for close at 1676127800563Writing region close event to WAL at 1676127800564 (+1 ms)Closed at 1676127800564 2023-02-11 15:03:20,567 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,567 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,570 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,572 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:20,573 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1 2023-02-11 15:03:20,573 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f30072536f47d4a1465cf0f8579c3e7f columnFamilyName f1 2023-02-11 15:03:20,578 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f1/testWithMapReduce=f30072536f47d4a1465cf0f8579c3e7f-f1cb15348fba41e7974c9a8069ddd03a 2023-02-11 15:03:20,578 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(310): Store=f30072536f47d4a1465cf0f8579c3e7f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,579 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f30072536f47d4a1465cf0f8579c3e7f 2023-02-11 15:03:20,579 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2 2023-02-11 15:03:20,580 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f30072536f47d4a1465cf0f8579c3e7f columnFamilyName f2 2023-02-11 15:03:20,584 DEBUG [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/f30072536f47d4a1465cf0f8579c3e7f/f2/testWithMapReduce=f30072536f47d4a1465cf0f8579c3e7f-33f71c6e1f4e49d49915953fb6024a4e 2023-02-11 15:03:20,584 INFO [StoreOpener-f30072536f47d4a1465cf0f8579c3e7f-1] regionserver.HStore(310): Store=f30072536f47d4a1465cf0f8579c3e7f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,584 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,584 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f30072536f47d4a1465cf0f8579c3e7f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65345447, jitterRate=-0.026276960968971252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,584 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f30072536f47d4a1465cf0f8579c3e7f: Writing region info on filesystem at 1676127800570Initializing all the Stores at 1676127800571 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800571Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800571Region opened successfully at 1676127800584 (+13 ms) 2023-02-11 15:03:20,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f30072536f47d4a1465cf0f8579c3e7f, disabling compactions & flushes 2023-02-11 15:03:20,615 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:20,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:20,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. after waiting 0 ms 2023-02-11 15:03:20,615 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:20,616 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676127794667.f30072536f47d4a1465cf0f8579c3e7f. 2023-02-11 15:03:20,616 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f30072536f47d4a1465cf0f8579c3e7f: Waiting for close lock at 1676127800615Disabling compacts and flushes for region at 1676127800615Disabling writes for close at 1676127800615Writing region close event to WAL at 1676127800616 (+1 ms)Closed at 1676127800616 2023-02-11 15:03:20,620 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,620 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,622 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,624 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:20,625 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1 2023-02-11 15:03:20,625 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93c48782c0080b931692516a8b1de449 columnFamilyName f1 2023-02-11 15:03:20,629 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f1/testWithMapReduce=93c48782c0080b931692516a8b1de449-16fe43b1a6be489ebf7d85c7dd34c363 2023-02-11 15:03:20,630 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(310): Store=93c48782c0080b931692516a8b1de449/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,630 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93c48782c0080b931692516a8b1de449 2023-02-11 15:03:20,631 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2 2023-02-11 15:03:20,631 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93c48782c0080b931692516a8b1de449 columnFamilyName f2 2023-02-11 15:03:20,635 DEBUG [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/93c48782c0080b931692516a8b1de449/f2/testWithMapReduce=93c48782c0080b931692516a8b1de449-1b20cefee632461f8233cc22857b4f9a 2023-02-11 15:03:20,636 INFO [StoreOpener-93c48782c0080b931692516a8b1de449-1] regionserver.HStore(310): Store=93c48782c0080b931692516a8b1de449/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,636 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 93c48782c0080b931692516a8b1de449; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61283339, jitterRate=-0.08680708706378937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,636 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 93c48782c0080b931692516a8b1de449: Writing region info on filesystem at 1676127800622Initializing all the Stores at 1676127800623 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800623Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800623Region opened successfully at 1676127800636 (+13 ms) 2023-02-11 15:03:20,667 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 93c48782c0080b931692516a8b1de449, disabling compactions & flushes 2023-02-11 15:03:20,667 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:20,667 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:20,667 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. after waiting 0 ms 2023-02-11 15:03:20,667 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:20,668 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676127794667.93c48782c0080b931692516a8b1de449. 2023-02-11 15:03:20,668 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 93c48782c0080b931692516a8b1de449: Waiting for close lock at 1676127800667Disabling compacts and flushes for region at 1676127800667Disabling writes for close at 1676127800667Writing region close event to WAL at 1676127800668 (+1 ms)Closed at 1676127800668 2023-02-11 15:03:20,671 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,671 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,672 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,674 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:20,675 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1 2023-02-11 15:03:20,675 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ca200f280be5e80a4a0b8884c99d615 columnFamilyName f1 2023-02-11 15:03:20,679 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f1/testWithMapReduce=9ca200f280be5e80a4a0b8884c99d615-8face590ab7242fdb6eaccd4654509c3 2023-02-11 15:03:20,680 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(310): Store=9ca200f280be5e80a4a0b8884c99d615/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,680 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ca200f280be5e80a4a0b8884c99d615 2023-02-11 15:03:20,681 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2 2023-02-11 15:03:20,681 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ca200f280be5e80a4a0b8884c99d615 columnFamilyName f2 2023-02-11 15:03:20,687 DEBUG [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/9ca200f280be5e80a4a0b8884c99d615/f2/testWithMapReduce=9ca200f280be5e80a4a0b8884c99d615-50e3386b7f4645ce980bf14cce8e99fa 2023-02-11 15:03:20,688 INFO [StoreOpener-9ca200f280be5e80a4a0b8884c99d615-1] regionserver.HStore(310): Store=9ca200f280be5e80a4a0b8884c99d615/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,688 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9ca200f280be5e80a4a0b8884c99d615; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70689747, jitterRate=0.05335931479930878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,688 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9ca200f280be5e80a4a0b8884c99d615: Writing region info on filesystem at 1676127800672Initializing all the Stores at 1676127800673 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800673Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800673Region opened successfully at 1676127800688 (+15 ms) 2023-02-11 15:03:20,721 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9ca200f280be5e80a4a0b8884c99d615, disabling compactions & flushes 2023-02-11 15:03:20,722 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:20,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:20,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. after waiting 0 ms 2023-02-11 15:03:20,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:20,722 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676127794667.9ca200f280be5e80a4a0b8884c99d615. 2023-02-11 15:03:20,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9ca200f280be5e80a4a0b8884c99d615: Waiting for close lock at 1676127800721Disabling compacts and flushes for region at 1676127800721Disabling writes for close at 1676127800722 (+1 ms)Writing region close event to WAL at 1676127800722Closed at 1676127800722 2023-02-11 15:03:20,725 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,725 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,728 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,729 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:20,731 DEBUG [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/f1 2023-02-11 15:03:20,731 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 734d9a680881f9d7559efd10e093fc24 columnFamilyName f1 2023-02-11 15:03:20,732 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(310): Store=734d9a680881f9d7559efd10e093fc24/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,732 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 734d9a680881f9d7559efd10e093fc24 2023-02-11 15:03:20,733 DEBUG [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/734d9a680881f9d7559efd10e093fc24/f2 2023-02-11 15:03:20,734 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 734d9a680881f9d7559efd10e093fc24 columnFamilyName f2 2023-02-11 15:03:20,734 INFO [StoreOpener-734d9a680881f9d7559efd10e093fc24-1] regionserver.HStore(310): Store=734d9a680881f9d7559efd10e093fc24/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,734 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,735 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 734d9a680881f9d7559efd10e093fc24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65676794, jitterRate=-0.021339505910873413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,735 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 734d9a680881f9d7559efd10e093fc24: Writing region info on filesystem at 1676127800728Initializing all the Stores at 1676127800729 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800729Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800729Region opened successfully at 1676127800735 (+6 ms) 2023-02-11 15:03:20,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 734d9a680881f9d7559efd10e093fc24, disabling compactions & flushes 2023-02-11 15:03:20,753 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:20,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:20,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. after waiting 0 ms 2023-02-11 15:03:20,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:20,754 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127794667.734d9a680881f9d7559efd10e093fc24. 2023-02-11 15:03:20,754 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 734d9a680881f9d7559efd10e093fc24: Waiting for close lock at 1676127800753Disabling compacts and flushes for region at 1676127800753Disabling writes for close at 1676127800753Writing region close event to WAL at 1676127800754 (+1 ms)Closed at 1676127800754 2023-02-11 15:03:20,757 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,758 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,759 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,761 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:20,761 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1 2023-02-11 15:03:20,762 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac89e902bd409aeb900a49780e6cd2f5 columnFamilyName f1 2023-02-11 15:03:20,766 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f1/testWithMapReduce=ac89e902bd409aeb900a49780e6cd2f5-71ce5132603f4fe0b90959865ace3021 2023-02-11 15:03:20,766 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(310): Store=ac89e902bd409aeb900a49780e6cd2f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,766 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac89e902bd409aeb900a49780e6cd2f5 2023-02-11 15:03:20,767 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2 2023-02-11 15:03:20,767 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac89e902bd409aeb900a49780e6cd2f5 columnFamilyName f2 2023-02-11 15:03:20,772 DEBUG [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/ac89e902bd409aeb900a49780e6cd2f5/f2/testWithMapReduce=ac89e902bd409aeb900a49780e6cd2f5-c86623944239417f972b8bff806c0afb 2023-02-11 15:03:20,772 INFO [StoreOpener-ac89e902bd409aeb900a49780e6cd2f5-1] regionserver.HStore(310): Store=ac89e902bd409aeb900a49780e6cd2f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,772 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ac89e902bd409aeb900a49780e6cd2f5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59908998, jitterRate=-0.10728636384010315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ac89e902bd409aeb900a49780e6cd2f5: Writing region info on filesystem at 1676127800759Initializing all the Stores at 1676127800760 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800760Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800760Region opened successfully at 1676127800772 (+12 ms) 2023-02-11 15:03:20,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ac89e902bd409aeb900a49780e6cd2f5, disabling compactions & flushes 2023-02-11 15:03:20,819 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:20,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:20,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. after waiting 0 ms 2023-02-11 15:03:20,819 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:20,820 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676127794667.ac89e902bd409aeb900a49780e6cd2f5. 2023-02-11 15:03:20,820 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ac89e902bd409aeb900a49780e6cd2f5: Waiting for close lock at 1676127800819Disabling compacts and flushes for region at 1676127800819Disabling writes for close at 1676127800819Writing region close event to WAL at 1676127800820 (+1 ms)Closed at 1676127800820 2023-02-11 15:03:20,822 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:20,822 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:20,824 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:20,826 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:20,827 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1 2023-02-11 15:03:20,828 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf319fb70658e28d441d56e493ccb6fc columnFamilyName f1 2023-02-11 15:03:20,832 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f1/testWithMapReduce=cf319fb70658e28d441d56e493ccb6fc-69870b3d1c32411291cc131eedef479e 2023-02-11 15:03:20,832 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(310): Store=cf319fb70658e28d441d56e493ccb6fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,832 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cf319fb70658e28d441d56e493ccb6fc 2023-02-11 15:03:20,833 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2 2023-02-11 15:03:20,833 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf319fb70658e28d441d56e493ccb6fc columnFamilyName f2 2023-02-11 15:03:20,840 DEBUG [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(539): loaded hdfs://localhost:33135/user/jenkins/test-data/0fcf947d-9776-b908-64eb-d03f9f796508/testWithMapReduceAndOfflineHBaseMultiRegion/6b250ad9-8b3e-4353-9ee9-f81efcb19e1a/data/default/testWithMapReduce/cf319fb70658e28d441d56e493ccb6fc/f2/testWithMapReduce=cf319fb70658e28d441d56e493ccb6fc-058628f0c5df4ed6995eb829d165011b 2023-02-11 15:03:20,840 INFO [StoreOpener-cf319fb70658e28d441d56e493ccb6fc-1] regionserver.HStore(310): Store=cf319fb70658e28d441d56e493ccb6fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:20,840 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:20,841 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cf319fb70658e28d441d56e493ccb6fc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63383018, jitterRate=-0.055519431829452515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:20,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cf319fb70658e28d441d56e493ccb6fc: Writing region info on filesystem at 1676127800824Initializing all the Stores at 1676127800825 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800825Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127800825Region opened successfully at 1676127800841 (+16 ms) 2023-02-11 15:03:20,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cf319fb70658e28d441d56e493ccb6fc, disabling compactions & flushes 2023-02-11 15:03:20,873 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:20,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:20,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. after waiting 0 ms 2023-02-11 15:03:20,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:20,875 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676127794667.cf319fb70658e28d441d56e493ccb6fc. 2023-02-11 15:03:20,875 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cf319fb70658e28d441d56e493ccb6fc: Waiting for close lock at 1676127800873Disabling compacts and flushes for region at 1676127800873Disabling writes for close at 1676127800874 (+1 ms)Writing region close event to WAL at 1676127800875 (+1 ms)Closed at 1676127800875 2023-02-11 15:03:21,348 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:21,348 WARN [Listener at localhost/33637] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:21,352 INFO [Listener at localhost/33637] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:21,456 WARN [BP-2046007961-172.31.14.131-1676127792500 heartbeating to localhost/127.0.0.1:33135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:21,456 WARN [BP-2046007961-172.31.14.131-1676127792500 heartbeating to localhost/127.0.0.1:33135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2046007961-172.31.14.131-1676127792500 (Datanode Uuid a271367d-f2f9-4c7e-8d84-669f656801b1) service to localhost/127.0.0.1:33135 2023-02-11 15:03:21,457 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/dfs/data/data3/current/BP-2046007961-172.31.14.131-1676127792500] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:21,457 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/dfs/data/data4/current/BP-2046007961-172.31.14.131-1676127792500] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:21,458 WARN [Listener at localhost/33637] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:21,465 INFO [Listener at localhost/33637] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:21,568 WARN [BP-2046007961-172.31.14.131-1676127792500 heartbeating to localhost/127.0.0.1:33135] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:21,568 WARN [BP-2046007961-172.31.14.131-1676127792500 heartbeating to localhost/127.0.0.1:33135] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2046007961-172.31.14.131-1676127792500 (Datanode Uuid 680f0b0c-2d89-4c51-8792-1043774aac2e) service to localhost/127.0.0.1:33135 2023-02-11 15:03:21,569 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/dfs/data/data1/current/BP-2046007961-172.31.14.131-1676127792500] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:21,569 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/cluster_45ed0ac1-09b6-f5e7-fc20-458c36627ad7/dfs/data/data2/current/BP-2046007961-172.31.14.131-1676127792500] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:21,579 INFO [Listener at localhost/33637] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:21,699 INFO [Listener at localhost/33637] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:21,742 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:21,755 INFO [Listener at localhost/33637] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=156 (was 102) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:33135 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:33135 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/33637 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:33135 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41051,1676127793183)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:33135 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:33135 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ForkJoinPool-3-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33135 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:33135 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=534 (was 543), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=4019 (was 4237) 2023-02-11 15:03:21,765 INFO [Listener at localhost/33637] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=156, OpenFileDescriptor=534, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=169, AvailableMemoryMB=4019 2023-02-11 15:03:21,777 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop.log.dir so I do NOT create it in target/test-data/5bd06873-0983-a9e3-83da-190a235b6072 2023-02-11 15:03:21,777 WARN [Listener at localhost/33637] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 15:03:21,777 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop.tmp.dir so I do NOT create it in target/test-data/5bd06873-0983-a9e3-83da-190a235b6072 2023-02-11 15:03:21,777 WARN [Listener at localhost/33637] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ee460754-5017-8ef6-09e5-8feb0c08539a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 15:03:21,777 DEBUG [Listener at localhost/33637] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072 2023-02-11 15:03:21,777 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:03:21,777 INFO [Listener at localhost/33637] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570, deleteOnExit=true 2023-02-11 15:03:21,777 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/test.cache.data in system properties and HBase conf 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:03:21,778 DEBUG [Listener at localhost/33637] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:21,778 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:21,779 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:03:21,780 INFO [Listener at localhost/33637] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:03:21,783 WARN [Listener at localhost/33637] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:21,784 WARN [Listener at localhost/33637] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:21,875 WARN [Listener at localhost/33637] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:21,879 INFO [Listener at localhost/33637] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:21,917 INFO [Listener at localhost/33637] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/java.io.tmpdir/Jetty_localhost_33223_hdfs____.srqldv/webapp 2023-02-11 15:03:22,010 INFO [Listener at localhost/33637] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33223 2023-02-11 15:03:22,014 WARN [Listener at localhost/33637] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:22,015 WARN [Listener at localhost/33637] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:22,056 WARN [Listener at localhost/39295] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:22,070 WARN [Listener at localhost/39295] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:22,075 WARN [Listener at localhost/39295] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:22,076 INFO [Listener at localhost/39295] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:22,082 INFO [Listener at localhost/39295] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/java.io.tmpdir/Jetty_localhost_41407_datanode____.klv23/webapp 2023-02-11 15:03:22,176 INFO [Listener at localhost/39295] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41407 2023-02-11 15:03:22,183 WARN [Listener at localhost/33757] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:22,221 WARN [Listener at localhost/33757] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:22,223 WARN [Listener at localhost/33757] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:22,224 INFO [Listener at localhost/33757] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:22,228 INFO [Listener at localhost/33757] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/java.io.tmpdir/Jetty_localhost_43655_datanode____az55q/webapp 2023-02-11 15:03:22,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f1a8bbad93c74cc: Processing first storage report for DS-b8659da8-008e-48d5-bae4-74d0da3c8739 from datanode b3f23fc7-73cd-4a13-9250-07d0b21b896b 2023-02-11 15:03:22,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f1a8bbad93c74cc: from storage DS-b8659da8-008e-48d5-bae4-74d0da3c8739 node DatanodeRegistration(127.0.0.1:33917, datanodeUuid=b3f23fc7-73cd-4a13-9250-07d0b21b896b, infoPort=36017, infoSecurePort=0, ipcPort=33757, storageInfo=lv=-57;cid=testClusterID;nsid=1133009574;c=1676127801786), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:22,298 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7f1a8bbad93c74cc: Processing first storage report for DS-0fa14620-8cf1-4997-b5f4-e0dcb5ec7761 from datanode b3f23fc7-73cd-4a13-9250-07d0b21b896b 2023-02-11 15:03:22,298 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7f1a8bbad93c74cc: from storage DS-0fa14620-8cf1-4997-b5f4-e0dcb5ec7761 node DatanodeRegistration(127.0.0.1:33917, datanodeUuid=b3f23fc7-73cd-4a13-9250-07d0b21b896b, infoPort=36017, infoSecurePort=0, ipcPort=33757, storageInfo=lv=-57;cid=testClusterID;nsid=1133009574;c=1676127801786), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:22,324 INFO [Listener at localhost/33757] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43655 2023-02-11 15:03:22,331 WARN [Listener at localhost/39377] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:22,428 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x37f4d9fd61565521: Processing first storage report for DS-3359be22-ff13-4370-8122-eb46676ed940 from datanode e5a9ae76-d806-450d-851c-ba9fb3f0afd2 2023-02-11 15:03:22,428 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x37f4d9fd61565521: from storage DS-3359be22-ff13-4370-8122-eb46676ed940 node DatanodeRegistration(127.0.0.1:43821, datanodeUuid=e5a9ae76-d806-450d-851c-ba9fb3f0afd2, infoPort=42367, infoSecurePort=0, ipcPort=39377, storageInfo=lv=-57;cid=testClusterID;nsid=1133009574;c=1676127801786), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:22,428 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x37f4d9fd61565521: Processing first storage report for DS-f9a67900-d2c6-41ea-9a0f-fc9e0561d431 from datanode e5a9ae76-d806-450d-851c-ba9fb3f0afd2 2023-02-11 15:03:22,428 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x37f4d9fd61565521: from storage DS-f9a67900-d2c6-41ea-9a0f-fc9e0561d431 node DatanodeRegistration(127.0.0.1:43821, datanodeUuid=e5a9ae76-d806-450d-851c-ba9fb3f0afd2, infoPort=42367, infoSecurePort=0, ipcPort=39377, storageInfo=lv=-57;cid=testClusterID;nsid=1133009574;c=1676127801786), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:22,442 DEBUG [Listener at localhost/39377] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072 2023-02-11 15:03:22,444 INFO [Listener at localhost/39377] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/zookeeper_0, clientPort=64097, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:03:22,446 INFO [Listener at localhost/39377] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64097 2023-02-11 15:03:22,446 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,447 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,459 INFO [Listener at localhost/39377] util.FSUtils(479): Created version file at hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e with version=8 2023-02-11 15:03:22,459 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,460 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,461 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39295/user/jenkins/test-data/cb31ae92-be18-9ca3-a185-e7726e01ed48/hbase-staging 2023-02-11 15:03:22,463 INFO [Listener at localhost/39377] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:22,464 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,464 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,464 INFO [Listener at localhost/39377] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:22,464 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,464 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:22,464 INFO [Listener at localhost/39377] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:22,466 INFO [Listener at localhost/39377] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45403 2023-02-11 15:03:22,466 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,467 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,468 INFO [Listener at localhost/39377] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45403 connecting to ZooKeeper ensemble=127.0.0.1:64097 2023-02-11 15:03:22,475 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:454030x0, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:22,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45403-0x10043e87e100000 connected 2023-02-11 15:03:22,495 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:22,495 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:22,495 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:22,496 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45403 2023-02-11 15:03:22,496 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45403 2023-02-11 15:03:22,496 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45403 2023-02-11 15:03:22,500 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45403 2023-02-11 15:03:22,500 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45403 2023-02-11 15:03:22,500 INFO [Listener at localhost/39377] master.HMaster(439): hbase.rootdir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e, hbase.cluster.distributed=false 2023-02-11 15:03:22,512 INFO [Listener at localhost/39377] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:22,513 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,513 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,513 INFO [Listener at localhost/39377] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:22,513 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,513 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:22,513 INFO [Listener at localhost/39377] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:22,515 INFO [Listener at localhost/39377] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38645 2023-02-11 15:03:22,515 INFO [Listener at localhost/39377] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:22,516 DEBUG [Listener at localhost/39377] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:22,516 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,517 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,518 INFO [Listener at localhost/39377] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38645 connecting to ZooKeeper ensemble=127.0.0.1:64097 2023-02-11 15:03:22,521 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:386450x0, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:22,522 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): regionserver:386450x0, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:22,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38645-0x10043e87e100001 connected 2023-02-11 15:03:22,523 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:22,524 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:22,528 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38645 2023-02-11 15:03:22,528 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38645 2023-02-11 15:03:22,528 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38645 2023-02-11 15:03:22,531 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38645 2023-02-11 15:03:22,531 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38645 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:22,542 INFO [Listener at localhost/39377] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:22,544 INFO [Listener at localhost/39377] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40541 2023-02-11 15:03:22,544 INFO [Listener at localhost/39377] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:22,545 DEBUG [Listener at localhost/39377] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:22,546 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,546 INFO [Listener at localhost/39377] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,547 INFO [Listener at localhost/39377] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40541 connecting to ZooKeeper ensemble=127.0.0.1:64097 2023-02-11 15:03:22,550 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:405410x0, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:22,553 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): regionserver:405410x0, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:22,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40541-0x10043e87e100002 connected 2023-02-11 15:03:22,553 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:22,554 DEBUG [Listener at localhost/39377] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:22,556 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40541 2023-02-11 15:03:22,560 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40541 2023-02-11 15:03:22,560 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40541 2023-02-11 15:03:22,560 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40541 2023-02-11 15:03:22,561 DEBUG [Listener at localhost/39377] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40541 2023-02-11 15:03:22,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,563 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:22,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,566 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:22,566 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:22,566 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:22,566 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:22,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45403,1676127802463 from backup master directory 2023-02-11 15:03:22,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:22,569 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,569 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:22,570 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:22,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/hbase.id with ID: 4305b863-1975-40b5-a836-10d57965e210 2023-02-11 15:03:22,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:22,599 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1c8edf31 to 127.0.0.1:64097 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:22,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@689cc3f5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:22,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:22,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:03:22,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:22,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store-tmp 2023-02-11 15:03:22,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:22,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:22,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:22,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:22,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:22,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:22,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:22,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127802622Disabling compacts and flushes for region at 1676127802622Disabling writes for close at 1676127802622Writing region close event to WAL at 1676127802622Closed at 1676127802622 2023-02-11 15:03:22,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/WALs/jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45403%2C1676127802463, suffix=, logDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/WALs/jenkins-hbase4.apache.org,45403,1676127802463, archiveDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/oldWALs, maxLogs=10 2023-02-11 15:03:22,642 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK] 2023-02-11 15:03:22,642 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK] 2023-02-11 15:03:22,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/WALs/jenkins-hbase4.apache.org,45403,1676127802463/jenkins-hbase4.apache.org%2C45403%2C1676127802463.1676127802625 2023-02-11 15:03:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK], DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK]] 2023-02-11 15:03:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:22,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:22,649 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:22,651 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:03:22,651 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:03:22,652 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:22,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:22,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:22,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:22,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:22,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67538418, jitterRate=0.006400853395462036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:22,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127802648Initializing all the Stores at 1676127802649 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127802649Cleaning up temporary data from old regions at 1676127802653 (+4 ms)Cleaning up detritus from prior splits at 1676127802653Region opened successfully at 1676127802657 (+4 ms) 2023-02-11 15:03:22,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:03:22,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:03:22,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:03:22,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:03:22,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 15:03:22,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 15:03:22,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:03:22,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:03:22,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:03:22,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:03:22,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:03:22,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:03:22,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:03:22,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:03:22,675 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:03:22,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:03:22,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:03:22,677 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:22,677 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:22,677 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,677 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:22,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45403,1676127802463, sessionid=0x10043e87e100000, setting cluster-up flag (Was=false) 2023-02-11 15:03:22,682 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:03:22,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,695 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:03:22,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:22,699 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.hbase-snapshot/.tmp 2023-02-11 15:03:22,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:22,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127832702 2023-02-11 15:03:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:03:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:03:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:03:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:03:22,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:03:22,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:03:22,703 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:22,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,703 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:03:22,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:03:22,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:03:22,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:03:22,704 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:22,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:03:22,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:03:22,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127802708,5,FailOnTimeoutGroup] 2023-02-11 15:03:22,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127802712,5,FailOnTimeoutGroup] 2023-02-11 15:03:22,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:03:22,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,720 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:22,720 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:22,721 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e 2023-02-11 15:03:22,730 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:22,732 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:22,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/info 2023-02-11 15:03:22,733 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:22,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:22,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:22,735 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:22,735 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:22,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:22,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:22,736 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/table 2023-02-11 15:03:22,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:22,737 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:22,738 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740 2023-02-11 15:03:22,738 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740 2023-02-11 15:03:22,740 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:22,741 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:22,742 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:22,743 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61765979, jitterRate=-0.07961519062519073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:22,743 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127802731Initializing all the Stores at 1676127802731Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127802731Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127802731Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127802731Cleaning up temporary data from old regions at 1676127802739 (+8 ms)Cleaning up detritus from prior splits at 1676127802739Region opened successfully at 1676127802743 (+4 ms) 2023-02-11 15:03:22,743 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:22,743 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:22,743 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:22,743 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:22,743 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:22,743 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:22,743 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127802743Disabling compacts and flushes for region at 1676127802743Disabling writes for close at 1676127802743Writing region close event to WAL at 1676127802743Closed at 1676127802743 2023-02-11 15:03:22,744 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:22,744 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:03:22,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:03:22,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:03:22,747 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:03:22,763 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(952): ClusterId : 4305b863-1975-40b5-a836-10d57965e210 2023-02-11 15:03:22,763 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(952): ClusterId : 4305b863-1975-40b5-a836-10d57965e210 2023-02-11 15:03:22,763 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:22,763 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:22,766 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:22,766 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:22,766 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:22,766 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:22,768 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:22,769 DEBUG [RS:0;jenkins-hbase4:38645] zookeeper.ReadOnlyZKClient(139): Connect 0x5e46c372 to 127.0.0.1:64097 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:22,769 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:22,770 DEBUG [RS:1;jenkins-hbase4:40541] zookeeper.ReadOnlyZKClient(139): Connect 0x12bf159b to 127.0.0.1:64097 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:22,777 DEBUG [RS:0;jenkins-hbase4:38645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@508126ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:22,777 DEBUG [RS:0;jenkins-hbase4:38645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54bea802, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:22,777 DEBUG [RS:1;jenkins-hbase4:40541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c78f9bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:22,777 DEBUG [RS:1;jenkins-hbase4:40541] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18477eeb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:22,786 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38645 2023-02-11 15:03:22,786 INFO [RS:0;jenkins-hbase4:38645] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:22,786 INFO [RS:0;jenkins-hbase4:38645] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:22,786 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:22,786 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45403,1676127802463 with isa=jenkins-hbase4.apache.org/172.31.14.131:38645, startcode=1676127802512 2023-02-11 15:03:22,786 DEBUG [RS:0;jenkins-hbase4:38645] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:22,788 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55071, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:22,790 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40541 2023-02-11 15:03:22,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,790 INFO [RS:1;jenkins-hbase4:40541] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:22,791 INFO [RS:1;jenkins-hbase4:40541] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:22,791 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:22,791 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e 2023-02-11 15:03:22,791 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39295 2023-02-11 15:03:22,791 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:22,791 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45403,1676127802463 with isa=jenkins-hbase4.apache.org/172.31.14.131:40541, startcode=1676127802541 2023-02-11 15:03:22,791 DEBUG [RS:1;jenkins-hbase4:40541] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:22,793 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:22,793 DEBUG [RS:0;jenkins-hbase4:38645] zookeeper.ZKUtil(162): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,793 WARN [RS:0;jenkins-hbase4:38645] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:22,793 INFO [RS:0;jenkins-hbase4:38645] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:22,793 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,795 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59305, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:22,796 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38645,1676127802512] 2023-02-11 15:03:22,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,798 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e 2023-02-11 15:03:22,798 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39295 2023-02-11 15:03:22,798 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:22,801 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:22,802 DEBUG [RS:1;jenkins-hbase4:40541] zookeeper.ZKUtil(162): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,802 DEBUG [RS:0;jenkins-hbase4:38645] zookeeper.ZKUtil(162): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,802 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40541,1676127802541] 2023-02-11 15:03:22,802 WARN [RS:1;jenkins-hbase4:40541] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:22,802 INFO [RS:1;jenkins-hbase4:40541] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:22,802 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,802 DEBUG [RS:0;jenkins-hbase4:38645] zookeeper.ZKUtil(162): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,803 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:22,803 INFO [RS:0;jenkins-hbase4:38645] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:22,806 INFO [RS:0;jenkins-hbase4:38645] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:22,807 INFO [RS:0;jenkins-hbase4:38645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:22,807 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,807 DEBUG [RS:1;jenkins-hbase4:40541] zookeeper.ZKUtil(162): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,807 DEBUG [RS:1;jenkins-hbase4:40541] zookeeper.ZKUtil(162): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,808 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:22,809 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:22,809 INFO [RS:1;jenkins-hbase4:40541] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:22,809 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,810 DEBUG [RS:0;jenkins-hbase4:38645] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,812 INFO [RS:1;jenkins-hbase4:40541] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:22,815 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,815 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,815 INFO [RS:1;jenkins-hbase4:40541] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:22,816 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,816 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,816 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:22,817 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,817 DEBUG [RS:1;jenkins-hbase4:40541] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:22,818 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,818 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,818 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,827 INFO [RS:0;jenkins-hbase4:38645] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:22,827 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38645,1676127802512-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,834 INFO [RS:1;jenkins-hbase4:40541] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:22,834 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40541,1676127802541-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:22,837 INFO [RS:0;jenkins-hbase4:38645] regionserver.Replication(203): jenkins-hbase4.apache.org,38645,1676127802512 started 2023-02-11 15:03:22,837 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38645,1676127802512, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38645, sessionid=0x10043e87e100001 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38645,1676127802512' 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38645,1676127802512' 2023-02-11 15:03:22,838 DEBUG [RS:0;jenkins-hbase4:38645] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:22,839 DEBUG [RS:0;jenkins-hbase4:38645] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:22,839 DEBUG [RS:0;jenkins-hbase4:38645] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:22,839 INFO [RS:0;jenkins-hbase4:38645] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:22,839 INFO [RS:0;jenkins-hbase4:38645] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:22,851 INFO [RS:1;jenkins-hbase4:40541] regionserver.Replication(203): jenkins-hbase4.apache.org,40541,1676127802541 started 2023-02-11 15:03:22,851 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40541,1676127802541, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40541, sessionid=0x10043e87e100002 2023-02-11 15:03:22,851 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:22,851 DEBUG [RS:1;jenkins-hbase4:40541] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,851 DEBUG [RS:1;jenkins-hbase4:40541] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40541,1676127802541' 2023-02-11 15:03:22,851 DEBUG [RS:1;jenkins-hbase4:40541] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40541,1676127802541' 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:22,852 DEBUG [RS:1;jenkins-hbase4:40541] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:22,853 DEBUG [RS:1;jenkins-hbase4:40541] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:22,853 INFO [RS:1;jenkins-hbase4:40541] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:22,853 INFO [RS:1;jenkins-hbase4:40541] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:22,897 DEBUG [jenkins-hbase4:45403] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:03:22,898 DEBUG [jenkins-hbase4:45403] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:22,899 DEBUG [jenkins-hbase4:45403] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:22,899 DEBUG [jenkins-hbase4:45403] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:22,899 DEBUG [jenkins-hbase4:45403] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:22,900 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40541,1676127802541, state=OPENING 2023-02-11 15:03:22,901 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:03:22,903 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:22,903 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:22,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40541,1676127802541}] 2023-02-11 15:03:23,058 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:23,058 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:23,059 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58600, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:23,063 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:03:23,064 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:23,065 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40541%2C1676127802541.meta, suffix=.meta, logDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,40541,1676127802541, archiveDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/oldWALs, maxLogs=32 2023-02-11 15:03:23,086 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK] 2023-02-11 15:03:23,086 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK] 2023-02-11 15:03:23,088 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,40541,1676127802541/jenkins-hbase4.apache.org%2C40541%2C1676127802541.meta.1676127803066.meta 2023-02-11 15:03:23,088 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK], DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK]] 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:03:23,089 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:03:23,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:03:23,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:23,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/info 2023-02-11 15:03:23,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/info 2023-02-11 15:03:23,092 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:23,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:23,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:23,093 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:23,093 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:23,093 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:23,094 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:23,094 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:23,095 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/table 2023-02-11 15:03:23,095 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/table 2023-02-11 15:03:23,095 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:23,096 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:23,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740 2023-02-11 15:03:23,097 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740 2023-02-11 15:03:23,099 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:23,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:23,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62010149, jitterRate=-0.07597677409648895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:23,101 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127803089Writing region info on filesystem at 1676127803089Initializing all the Stores at 1676127803090 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127803090Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127803090Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127803090Cleaning up temporary data from old regions at 1676127803098 (+8 ms)Cleaning up detritus from prior splits at 1676127803098Running coprocessor post-open hooks at 1676127803101 (+3 ms)Region opened successfully at 1676127803101 2023-02-11 15:03:23,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127803057 2023-02-11 15:03:23,106 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:03:23,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:03:23,107 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40541,1676127802541, state=OPEN 2023-02-11 15:03:23,109 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:03:23,109 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:23,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:03:23,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40541,1676127802541 in 206 msec 2023-02-11 15:03:23,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:03:23,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-11 15:03:23,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 414 msec 2023-02-11 15:03:23,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127802564, completionTime=-1 2023-02-11 15:03:23,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:03:23,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:03:23,117 DEBUG [hconnection-0x3af562d0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:23,118 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58608, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:23,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:03:23,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127863120 2023-02-11 15:03:23,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127923120 2023-02-11 15:03:23,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45403,1676127802463-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45403,1676127802463-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45403,1676127802463-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45403, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:03:23,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:23,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:03:23,133 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:03:23,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:23,134 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:23,135 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,136 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c empty. 2023-02-11 15:03:23,136 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,136 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:03:23,148 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:23,149 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3e47394b0fef67722b4a6bb63e40b67c, NAME => 'hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp 2023-02-11 15:03:23,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:23,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 3e47394b0fef67722b4a6bb63e40b67c, disabling compactions & flushes 2023-02-11 15:03:23,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. after waiting 0 ms 2023-02-11 15:03:23,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 3e47394b0fef67722b4a6bb63e40b67c: Waiting for close lock at 1676127803155Disabling compacts and flushes for region at 1676127803155Disabling writes for close at 1676127803155Writing region close event to WAL at 1676127803155Closed at 1676127803155 2023-02-11 15:03:23,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:23,157 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127803157"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127803157"}]},"ts":"1676127803157"} 2023-02-11 15:03:23,159 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:23,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:23,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127803160"}]},"ts":"1676127803160"} 2023-02-11 15:03:23,161 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:23,164 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:23,165 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:23,165 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:23,165 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:23,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3e47394b0fef67722b4a6bb63e40b67c, ASSIGN}] 2023-02-11 15:03:23,167 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=3e47394b0fef67722b4a6bb63e40b67c, ASSIGN 2023-02-11 15:03:23,168 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=3e47394b0fef67722b4a6bb63e40b67c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38645,1676127802512; forceNewPlan=false, retain=false 2023-02-11 15:03:23,318 INFO [jenkins-hbase4:45403] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:23,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3e47394b0fef67722b4a6bb63e40b67c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:23,320 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127803319"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127803319"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127803319"}]},"ts":"1676127803319"} 2023-02-11 15:03:23,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 3e47394b0fef67722b4a6bb63e40b67c, server=jenkins-hbase4.apache.org,38645,1676127802512}] 2023-02-11 15:03:23,406 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:23,473 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:23,474 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:23,475 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:23,479 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,480 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38645%2C1676127802512, suffix=, logDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,38645,1676127802512, archiveDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/oldWALs, maxLogs=32 2023-02-11 15:03:23,498 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK] 2023-02-11 15:03:23,498 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK] 2023-02-11 15:03:23,500 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,38645,1676127802512/jenkins-hbase4.apache.org%2C38645%2C1676127802512.1676127803481 2023-02-11 15:03:23,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK], DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK]] 2023-02-11 15:03:23,500 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e47394b0fef67722b4a6bb63e40b67c, NAME => 'hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:23,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:23,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,501 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,502 INFO [StoreOpener-3e47394b0fef67722b4a6bb63e40b67c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,503 DEBUG [StoreOpener-3e47394b0fef67722b4a6bb63e40b67c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/info 2023-02-11 15:03:23,503 DEBUG [StoreOpener-3e47394b0fef67722b4a6bb63e40b67c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/info 2023-02-11 15:03:23,504 INFO [StoreOpener-3e47394b0fef67722b4a6bb63e40b67c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e47394b0fef67722b4a6bb63e40b67c columnFamilyName info 2023-02-11 15:03:23,504 INFO [StoreOpener-3e47394b0fef67722b4a6bb63e40b67c-1] regionserver.HStore(310): Store=3e47394b0fef67722b4a6bb63e40b67c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:23,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,505 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:23,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:23,513 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3e47394b0fef67722b4a6bb63e40b67c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66699423, jitterRate=-0.006101146340370178}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:23,513 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3e47394b0fef67722b4a6bb63e40b67c: Running coprocessor pre-open hook at 1676127803501Writing region info on filesystem at 1676127803501Initializing all the Stores at 1676127803501Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127803501Cleaning up temporary data from old regions at 1676127803505 (+4 ms)Cleaning up detritus from prior splits at 1676127803506 (+1 ms)Running coprocessor post-open hooks at 1676127803513 (+7 ms)Region opened successfully at 1676127803513 2023-02-11 15:03:23,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c., pid=6, masterSystemTime=1676127803473 2023-02-11 15:03:23,517 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,517 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:23,518 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=3e47394b0fef67722b4a6bb63e40b67c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:23,518 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127803518"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127803518"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127803518"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127803518"}]},"ts":"1676127803518"} 2023-02-11 15:03:23,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:23,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 3e47394b0fef67722b4a6bb63e40b67c, server=jenkins-hbase4.apache.org,38645,1676127802512 in 197 msec 2023-02-11 15:03:23,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:23,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=3e47394b0fef67722b4a6bb63e40b67c, ASSIGN in 356 msec 2023-02-11 15:03:23,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:23,524 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127803524"}]},"ts":"1676127803524"} 2023-02-11 15:03:23,526 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:23,529 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:23,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 398 msec 2023-02-11 15:03:23,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:23,534 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:23,535 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:23,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:23,539 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:23,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:23,548 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:23,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-11 15:03:23,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:23,569 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:23,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-11 15:03:23,577 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:23,579 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:23,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.009sec 2023-02-11 15:03:23,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:23,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:23,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:23,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45403,1676127802463-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:23,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45403,1676127802463-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:23,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:23,664 DEBUG [Listener at localhost/39377] zookeeper.ReadOnlyZKClient(139): Connect 0x785535ff to 127.0.0.1:64097 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:23,669 DEBUG [Listener at localhost/39377] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71e7c016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:23,675 DEBUG [hconnection-0x2d9cf438-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:23,677 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59194, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:23,678 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:23,679 DEBUG [Listener at localhost/39377] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:23,681 DEBUG [Listener at localhost/39377] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:23,682 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49550, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:23,683 INFO [Listener at localhost/39377] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:23,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:23,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:23,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:49550 deadline: 1676127863683, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:23,684 INFO [Listener at localhost/39377] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-11 15:03:23,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:23,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:23,689 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:23,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-11 15:03:23,689 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:23,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:23,691 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:23,692 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee empty. 2023-02-11 15:03:23,692 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:23,692 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-11 15:03:23,705 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:23,706 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => fd00244a98f00cc68f78d4d4edb75aee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp 2023-02-11 15:03:23,713 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:23,714 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing fd00244a98f00cc68f78d4d4edb75aee, disabling compactions & flushes 2023-02-11 15:03:23,714 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:23,714 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:23,714 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. after waiting 0 ms 2023-02-11 15:03:23,714 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:23,714 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:23,714 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for fd00244a98f00cc68f78d4d4edb75aee: Waiting for close lock at 1676127803714Disabling compacts and flushes for region at 1676127803714Disabling writes for close at 1676127803714Writing region close event to WAL at 1676127803714Closed at 1676127803714 2023-02-11 15:03:23,716 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:23,717 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676127803717"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127803717"}]},"ts":"1676127803717"} 2023-02-11 15:03:23,719 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:23,719 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:23,720 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127803720"}]},"ts":"1676127803720"} 2023-02-11 15:03:23,721 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-11 15:03:23,730 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:23,731 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:23,731 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:23,731 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:23,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, ASSIGN}] 2023-02-11 15:03:23,734 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, ASSIGN 2023-02-11 15:03:23,735 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40541,1676127802541; forceNewPlan=false, retain=false 2023-02-11 15:03:23,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:23,854 INFO [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40541%2C1676127802541, suffix=, logDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,40541,1676127802541, archiveDir=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/oldWALs, maxLogs=32 2023-02-11 15:03:23,869 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK] 2023-02-11 15:03:23,869 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK] 2023-02-11 15:03:23,871 INFO [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/WALs/jenkins-hbase4.apache.org,40541,1676127802541/jenkins-hbase4.apache.org%2C40541%2C1676127802541.1676127803855 2023-02-11 15:03:23,871 DEBUG [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33917,DS-b8659da8-008e-48d5-bae4-74d0da3c8739,DISK], DatanodeInfoWithStorage[127.0.0.1:43821,DS-3359be22-ff13-4370-8122-eb46676ed940,DISK]] 2023-02-11 15:03:23,885 INFO [jenkins-hbase4:45403] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:23,886 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fd00244a98f00cc68f78d4d4edb75aee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:23,887 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676127803886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127803886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127803886"}]},"ts":"1676127803886"} 2023-02-11 15:03:23,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure fd00244a98f00cc68f78d4d4edb75aee, server=jenkins-hbase4.apache.org,40541,1676127802541}] 2023-02-11 15:03:23,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:24,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:24,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fd00244a98f00cc68f78d4d4edb75aee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:24,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:24,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,045 INFO [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,046 DEBUG [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1 2023-02-11 15:03:24,046 DEBUG [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1 2023-02-11 15:03:24,047 INFO [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd00244a98f00cc68f78d4d4edb75aee columnFamilyName f1 2023-02-11 15:03:24,047 INFO [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] regionserver.HStore(310): Store=fd00244a98f00cc68f78d4d4edb75aee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:24,047 INFO [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,048 DEBUG [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2 2023-02-11 15:03:24,048 DEBUG [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2 2023-02-11 15:03:24,049 INFO [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd00244a98f00cc68f78d4d4edb75aee columnFamilyName f2 2023-02-11 15:03:24,049 INFO [StoreOpener-fd00244a98f00cc68f78d4d4edb75aee-1] regionserver.HStore(310): Store=fd00244a98f00cc68f78d4d4edb75aee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:24,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:24,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fd00244a98f00cc68f78d4d4edb75aee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62213622, jitterRate=-0.07294479012489319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:24,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fd00244a98f00cc68f78d4d4edb75aee: Running coprocessor pre-open hook at 1676127804044Writing region info on filesystem at 1676127804044Initializing all the Stores at 1676127804045 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127804045Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127804045Cleaning up temporary data from old regions at 1676127804051 (+6 ms)Cleaning up detritus from prior splits at 1676127804051Running coprocessor post-open hooks at 1676127804055 (+4 ms)Region opened successfully at 1676127804055 2023-02-11 15:03:24,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee., pid=12, masterSystemTime=1676127804040 2023-02-11 15:03:24,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:24,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:24,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=fd00244a98f00cc68f78d4d4edb75aee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,058 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676127804058"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127804058"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127804058"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127804058"}]},"ts":"1676127804058"} 2023-02-11 15:03:24,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 15:03:24,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure fd00244a98f00cc68f78d4d4edb75aee, server=jenkins-hbase4.apache.org,40541,1676127802541 in 172 msec 2023-02-11 15:03:24,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 15:03:24,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, ASSIGN in 330 msec 2023-02-11 15:03:24,063 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:24,063 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127804063"}]},"ts":"1676127804063"} 2023-02-11 15:03:24,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-11 15:03:24,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:24,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 381 msec 2023-02-11 15:03:24,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:24,295 INFO [Listener at localhost/39377] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-11 15:03:24,296 DEBUG [Listener at localhost/39377] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-11 15:03:24,296 INFO [Listener at localhost/39377] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:24,298 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-11 15:03:24,298 INFO [Listener at localhost/39377] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:24,298 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-11 15:03:24,299 INFO [Listener at localhost/39377] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:24,360 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40541] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:24,527 INFO [Listener at localhost/39377] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:24,527 INFO [Listener at localhost/39377] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:24,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 15:03:24,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127804529 (current time:1676127804529). 2023-02-11 15:03:24,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:24,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] zookeeper.ReadOnlyZKClient(139): Connect 0x11ba28ce to 127.0.0.1:64097 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:24,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65737aee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:24,537 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59196, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11ba28ce to 127.0.0.1:64097 2023-02-11 15:03:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 15:03:24,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 15:03:24,541 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 15:03:24,542 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676128404542 2023-02-11 15:03:24,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-11 15:03:24,542 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:24,543 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:24,543 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:24,544 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-11 15:03:24,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 15:03:24,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-11 15:03:24,545 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 15:03:24,546 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676128404546 2023-02-11 15:03:24,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-11 15:03:24,555 INFO [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-11 15:03:24,555 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:24,556 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-11 15:03:24,556 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-11 15:03:24,557 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,557 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,558 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:24,558 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:24,558 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:24,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:24,559 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,559 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 15:03:24,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 15:03:24,561 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 15:03:24,561 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:24,561 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 15:03:24,561 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 15:03:24,562 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 15:03:24,561 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:24,562 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40541,1676127802541' joining acquired barrier for procedure (foo) in zk 2023-02-11 15:03:24,562 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 15:03:24,562 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 15:03:24,562 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38645,1676127802512' joining acquired barrier for procedure (foo) in zk 2023-02-11 15:03:24,564 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,564 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:24,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:24,565 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,565 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,565 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:24,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:24,565 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,565 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:24,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40541,1676127802541' joining acquired barrier for procedure 'foo' on coordinator 2023-02-11 15:03:24,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@707599ff[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:24,567 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-11 15:03:24,567 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,569 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,569 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 15:03:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 15:03:24,570 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,38645,1676127802512' in zk 2023-02-11 15:03:24,570 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 15:03:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 15:03:24,570 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:24,570 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:24,570 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. started... 2023-02-11 15:03:24,571 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fd00244a98f00cc68f78d4d4edb75aee 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 15:03:24,572 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 15:03:24,572 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:24,572 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 15:03:24,590 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f1/3f3947c611e64e26bfc23cdf762be038 2023-02-11 15:03:24,609 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f2/54e3aba20eb8459983876d2f58aae3ad 2023-02-11 15:03:24,614 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f1/3f3947c611e64e26bfc23cdf762be038 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/3f3947c611e64e26bfc23cdf762be038 2023-02-11 15:03:24,618 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/3f3947c611e64e26bfc23cdf762be038, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:24,619 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f2/54e3aba20eb8459983876d2f58aae3ad as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/54e3aba20eb8459983876d2f58aae3ad 2023-02-11 15:03:24,623 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/54e3aba20eb8459983876d2f58aae3ad, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:24,624 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for fd00244a98f00cc68f78d4d4edb75aee in 53ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:24,624 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fd00244a98f00cc68f78d4d4edb75aee: 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.' region-info for snapshot=foo 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/3f3947c611e64e26bfc23cdf762be038] hfiles 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/3f3947c611e64e26bfc23cdf762be038 for snapshot=foo 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/54e3aba20eb8459983876d2f58aae3ad] hfiles 2023-02-11 15:03:24,625 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/54e3aba20eb8459983876d2f58aae3ad for snapshot=foo 2023-02-11 15:03:24,643 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. completed. 2023-02-11 15:03:24,643 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:24,643 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 15:03:24,644 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 15:03:24,644 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,644 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 15:03:24,644 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40541,1676127802541' in zk 2023-02-11 15:03:24,644 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:24,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 15:03:24,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:24,645 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:24,645 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,645 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 15:03:24,646 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:24,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:24,646 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 15:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:24,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:24,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,40541,1676127802541': 2023-02-11 15:03:24,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40541,1676127802541' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-11 15:03:24,649 INFO [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-11 15:03:24,649 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:24,649 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:24,649 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-11 15:03:24,649 INFO [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:24,651 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:24,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:24,651 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:24,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,651 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,652 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:24,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:24,652 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,654 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:24,654 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,665 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,665 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:24,665 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:24,665 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:24,665 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:24,665 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-11 15:03:24,665 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-11 15:03:24,666 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,666 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:24,666 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:24,667 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:24,665 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:24,667 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:24,667 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:24,667 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:24,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:24,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.hbase-snapshot/.tmp/foo 2023-02-11 15:03:24,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.hbase-snapshot/.tmp/foo to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.hbase-snapshot/foo 2023-02-11 15:03:24,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-11 15:03:24,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.hbase-snapshot/.tmp/foo 2023-02-11 15:03:24,710 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.hbase-snapshot/.tmp/foo 2023-02-11 15:03:24,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676127804542Consolidate snapshot: foo at 1676127804665 (+123 ms)Loading Region manifests for foo at 1676127804666 (+1 ms)Writing data manifest for foo at 1676127804670 (+4 ms)Verifying snapshot: foo at 1676127804684 (+14 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676127804710 (+26 ms) 2023-02-11 15:03:24,712 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-11 15:03:24,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 169 msec 2023-02-11 15:03:24,846 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:24,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-11 15:03:24,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:24,847 INFO [Listener at localhost/39377] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:24,851 INFO [Listener at localhost/39377] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:24,857 INFO [Listener at localhost/39377] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:24,947 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40541] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,082 INFO [Listener at localhost/39377] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:25,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:25,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,095 INFO [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-11 15:03:25,095 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:25,096 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-11 15:03:25,096 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-11 15:03:25,097 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,097 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,098 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:25,098 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:25,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:25,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:25,098 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,099 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,099 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:25,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,100 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-11 15:03:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-11 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-11 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 15:03:25,105 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:25,105 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. started... 2023-02-11 15:03:25,105 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-11 15:03:25,106 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fd00244a98f00cc68f78d4d4edb75aee 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 15:03:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-11 15:03:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38645,1676127802512' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-11 15:03:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,109 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,109 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:25,126 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f1/b522bdc25684448ab64309b86dab1bc2 2023-02-11 15:03:25,146 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f2/c0b27c7cd5a948dba0577c8f67f14723 2023-02-11 15:03:25,150 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f1/b522bdc25684448ab64309b86dab1bc2 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/b522bdc25684448ab64309b86dab1bc2 2023-02-11 15:03:25,153 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/b522bdc25684448ab64309b86dab1bc2, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:25,154 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/.tmp/f2/c0b27c7cd5a948dba0577c8f67f14723 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/c0b27c7cd5a948dba0577c8f67f14723 2023-02-11 15:03:25,158 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/c0b27c7cd5a948dba0577c8f67f14723, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:25,158 INFO [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for fd00244a98f00cc68f78d4d4edb75aee in 52ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:25,159 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fd00244a98f00cc68f78d4d4edb75aee: 2023-02-11 15:03:25,159 DEBUG [rs(jenkins-hbase4.apache.org,40541,1676127802541)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 15:03:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 15:03:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,159 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-11 15:03:25,160 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40541,1676127802541' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-11 15:03:25,165 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,165 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:25,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,166 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:25,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40541,1676127802541' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-11 15:03:25,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@744a1329[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:25,167 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-11 15:03:25,167 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,168 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,168 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,168 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-11 15:03:25,169 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,169 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-11 15:03:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,38645,1676127802512' in zk 2023-02-11 15:03:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-11 15:03:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-11 15:03:25,169 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,40541,1676127802541' in zk 2023-02-11 15:03:25,170 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-11 15:03:25,170 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:25,170 DEBUG [member: 'jenkins-hbase4.apache.org,38645,1676127802512' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-11 15:03:25,171 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,171 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-11 15:03:25,171 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:25,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:25,171 DEBUG [member: 'jenkins-hbase4.apache.org,40541,1676127802541' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-11 15:03:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:25,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:25,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:25,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,40541,1676127802541': 2023-02-11 15:03:25,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40541,1676127802541' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-11 15:03:25,175 INFO [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-11 15:03:25,175 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:25,175 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:25,175 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,175 INFO [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:25,178 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:25,178 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:25,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:25,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:25,179 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:25,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,179 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:25,180 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,181 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:25,183 DEBUG [(jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:25,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-11 15:03:25,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:25,183 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:25,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:25,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:25,184 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:25,185 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:25,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:25,285 DEBUG [Listener at localhost/39377] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:25,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:25,290 INFO [Listener at localhost/39377] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676127804529 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:25,291 DEBUG [Listener at localhost/39377] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39295/user/jenkins/test-data/cb31ae92-be18-9ca3-a185-e7726e01ed48/foo/7caeb781-4608-4a75-bffe-bfe99943692b/data/default/testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,291 INFO [Listener at localhost/39377] snapshot.RestoreSnapshotHelper(239): region to add: fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:25,291 INFO [Listener at localhost/39377] snapshot.RestoreSnapshotHelper(585): clone region=fd00244a98f00cc68f78d4d4edb75aee as fd00244a98f00cc68f78d4d4edb75aee in snapshot foo 2023-02-11 15:03:25,292 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => fd00244a98f00cc68f78d4d4edb75aee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39295/user/jenkins/test-data/cb31ae92-be18-9ca3-a185-e7726e01ed48/foo/7caeb781-4608-4a75-bffe-bfe99943692b 2023-02-11 15:03:25,303 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:25,303 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3f3947c611e64e26bfc23cdf762be038 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,305 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54e3aba20eb8459983876d2f58aae3ad from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,307 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing fd00244a98f00cc68f78d4d4edb75aee, disabling compactions & flushes 2023-02-11 15:03:25,307 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,307 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,307 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. after waiting 0 ms 2023-02-11 15:03:25,307 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,307 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,307 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for fd00244a98f00cc68f78d4d4edb75aee: Waiting for close lock at 1676127805307Disabling compacts and flushes for region at 1676127805307Disabling writes for close at 1676127805307Writing region close event to WAL at 1676127805307Closed at 1676127805307 2023-02-11 15:03:25,307 INFO [Listener at localhost/39377] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676127804529 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:25,307 DEBUG [Listener at localhost/39377] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39295/user/jenkins/test-data/cb31ae92-be18-9ca3-a185-e7726e01ed48/foo/7caeb781-4608-4a75-bffe-bfe99943692b 2023-02-11 15:03:25,307 DEBUG [Listener at localhost/39377] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39295/user/jenkins/test-data/cb31ae92-be18-9ca3-a185-e7726e01ed48/foo/7caeb781-4608-4a75-bffe-bfe99943692b 2023-02-11 15:03:25,308 DEBUG [Listener at localhost/39377] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:25,309 DEBUG [Listener at localhost/39377] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:25,309 DEBUG [Listener at localhost/39377] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-11 15:03:25,309 DEBUG [Listener at localhost/39377] util.CommonFSUtils(699): |----------fd00244a98f00cc68f78d4d4edb75aee/ 2023-02-11 15:03:25,310 DEBUG [Listener at localhost/39377] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:25,310 DEBUG [Listener at localhost/39377] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:25,310 DEBUG [Listener at localhost/39377] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=fd00244a98f00cc68f78d4d4edb75aee-3f3947c611e64e26bfc23cdf762be038 2023-02-11 15:03:25,310 DEBUG [Listener at localhost/39377] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:25,311 DEBUG [Listener at localhost/39377] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=fd00244a98f00cc68f78d4d4edb75aee-54e3aba20eb8459983876d2f58aae3ad 2023-02-11 15:03:25,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-11 15:03:25,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-11 15:03:25,316 INFO [Listener at localhost/39377] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,320 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127805319"}]},"ts":"1676127805319"} 2023-02-11 15:03:25,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:25,321 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-11 15:03:25,322 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-11 15:03:25,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, UNASSIGN}] 2023-02-11 15:03:25,324 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, UNASSIGN 2023-02-11 15:03:25,325 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fd00244a98f00cc68f78d4d4edb75aee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,325 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676127805325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127805325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127805325"}]},"ts":"1676127805325"} 2023-02-11 15:03:25,326 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure fd00244a98f00cc68f78d4d4edb75aee, server=jenkins-hbase4.apache.org,40541,1676127802541}] 2023-02-11 15:03:25,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:25,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:25,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fd00244a98f00cc68f78d4d4edb75aee, disabling compactions & flushes 2023-02-11 15:03:25,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. after waiting 0 ms 2023-02-11 15:03:25,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:25,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee. 2023-02-11 15:03:25,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fd00244a98f00cc68f78d4d4edb75aee: Waiting for close lock at 1676127805478Running coprocessor pre-close hooks at 1676127805478Disabling compacts and flushes for region at 1676127805478Disabling writes for close at 1676127805478Writing region close event to WAL at 1676127805479 (+1 ms)Running coprocessor post-close hooks at 1676127805483 (+4 ms)Closed at 1676127805483 2023-02-11 15:03:25,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:25,485 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=fd00244a98f00cc68f78d4d4edb75aee, regionState=CLOSED 2023-02-11 15:03:25,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676127805485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127805485"}]},"ts":"1676127805485"} 2023-02-11 15:03:25,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 15:03:25,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure fd00244a98f00cc68f78d4d4edb75aee, server=jenkins-hbase4.apache.org,40541,1676127802541 in 160 msec 2023-02-11 15:03:25,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 15:03:25,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=fd00244a98f00cc68f78d4d4edb75aee, UNASSIGN in 165 msec 2023-02-11 15:03:25,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127805490"}]},"ts":"1676127805490"} 2023-02-11 15:03:25,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-11 15:03:25,492 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-11 15:03:25,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-11 15:03:25,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:25,623 INFO [Listener at localhost/39377] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-11 15:03:25,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,627 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,627 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:25,631 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:25,633 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1, FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2, FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/recovered.edits] 2023-02-11 15:03:25,636 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/3f3947c611e64e26bfc23cdf762be038 to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/archive/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/3f3947c611e64e26bfc23cdf762be038 2023-02-11 15:03:25,637 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/b522bdc25684448ab64309b86dab1bc2 to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/archive/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f1/b522bdc25684448ab64309b86dab1bc2 2023-02-11 15:03:25,640 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/54e3aba20eb8459983876d2f58aae3ad to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/archive/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/54e3aba20eb8459983876d2f58aae3ad 2023-02-11 15:03:25,641 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/c0b27c7cd5a948dba0577c8f67f14723 to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/archive/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/f2/c0b27c7cd5a948dba0577c8f67f14723 2023-02-11 15:03:25,644 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/recovered.edits/12.seqid to hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/archive/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee/recovered.edits/12.seqid 2023-02-11 15:03:25,644 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/.tmp/data/default/testInitTableSnapshotMapperJobConfig/fd00244a98f00cc68f78d4d4edb75aee 2023-02-11 15:03:25,644 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-11 15:03:25,646 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,648 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-11 15:03:25,650 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-11 15:03:25,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,651 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-11 15:03:25,651 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127805651"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:25,652 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 15:03:25,652 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fd00244a98f00cc68f78d4d4edb75aee, NAME => 'testInitTableSnapshotMapperJobConfig,,1676127803686.fd00244a98f00cc68f78d4d4edb75aee.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 15:03:25,652 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-11 15:03:25,652 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676127805652"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:25,656 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-11 15:03:25,658 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-11 15:03:25,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-11 15:03:25,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45403] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:25,730 INFO [Listener at localhost/39377] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-11 15:03:25,730 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:25,730 INFO [Listener at localhost/39377] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:25,730 DEBUG [Listener at localhost/39377] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785535ff to 127.0.0.1:64097 2023-02-11 15:03:25,730 DEBUG [Listener at localhost/39377] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,730 DEBUG [Listener at localhost/39377] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:25,731 DEBUG [Listener at localhost/39377] util.JVMClusterUtil(257): Found active master hash=651344727, stopped=false 2023-02-11 15:03:25,731 INFO [Listener at localhost/39377] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:25,733 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:25,733 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:25,733 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:25,733 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:25,733 INFO [Listener at localhost/39377] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:25,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:25,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:25,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:25,735 DEBUG [Listener at localhost/39377] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c8edf31 to 127.0.0.1:64097 2023-02-11 15:03:25,735 DEBUG [Listener at localhost/39377] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,735 INFO [Listener at localhost/39377] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38645,1676127802512' ***** 2023-02-11 15:03:25,736 INFO [Listener at localhost/39377] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:25,736 INFO [Listener at localhost/39377] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40541,1676127802541' ***** 2023-02-11 15:03:25,736 INFO [Listener at localhost/39377] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:25,736 INFO [RS:0;jenkins-hbase4:38645] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:25,736 INFO [RS:1;jenkins-hbase4:40541] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:25,736 INFO [RS:0;jenkins-hbase4:38645] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:25,736 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:25,736 INFO [RS:0;jenkins-hbase4:38645] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:25,736 INFO [RS:1;jenkins-hbase4:40541] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:25,737 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(3304): Received CLOSE for 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:25,737 INFO [RS:1;jenkins-hbase4:40541] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:25,737 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,737 DEBUG [RS:1;jenkins-hbase4:40541] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12bf159b to 127.0.0.1:64097 2023-02-11 15:03:25,737 DEBUG [RS:1;jenkins-hbase4:40541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,738 INFO [RS:1;jenkins-hbase4:40541] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:25,737 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:25,738 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,738 DEBUG [RS:0;jenkins-hbase4:38645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e46c372 to 127.0.0.1:64097 2023-02-11 15:03:25,738 DEBUG [RS:0;jenkins-hbase4:38645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,738 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:25,738 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1479): Online Regions={3e47394b0fef67722b4a6bb63e40b67c=hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c.} 2023-02-11 15:03:25,738 INFO [RS:1;jenkins-hbase4:40541] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:25,738 INFO [RS:1;jenkins-hbase4:40541] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:25,738 DEBUG [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1505): Waiting on 3e47394b0fef67722b4a6bb63e40b67c 2023-02-11 15:03:25,738 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3e47394b0fef67722b4a6bb63e40b67c, disabling compactions & flushes 2023-02-11 15:03:25,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. after waiting 0 ms 2023-02-11 15:03:25,740 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:25,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:25,740 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 15:03:25,740 DEBUG [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:25,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 3e47394b0fef67722b4a6bb63e40b67c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:25,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:25,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:25,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:25,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:25,741 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:25,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-11 15:03:25,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/.tmp/info/46d4aae83edd4c53a42937dfe7e3dac4 2023-02-11 15:03:25,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/.tmp/info/4042741ba6524d688b15d554c43bb2e1 2023-02-11 15:03:25,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/.tmp/info/46d4aae83edd4c53a42937dfe7e3dac4 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/info/46d4aae83edd4c53a42937dfe7e3dac4 2023-02-11 15:03:25,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4042741ba6524d688b15d554c43bb2e1 2023-02-11 15:03:25,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/info/46d4aae83edd4c53a42937dfe7e3dac4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:25,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3e47394b0fef67722b4a6bb63e40b67c in 28ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:25,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/.tmp/rep_barrier/5c34e40bd9da4d2088aa923a4350101a 2023-02-11 15:03:25,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/namespace/3e47394b0fef67722b4a6bb63e40b67c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:25,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:25,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3e47394b0fef67722b4a6bb63e40b67c: Waiting for close lock at 1676127805739Running coprocessor pre-close hooks at 1676127805739Disabling compacts and flushes for region at 1676127805739Disabling writes for close at 1676127805740 (+1 ms)Obtaining lock to block concurrent updates at 1676127805741 (+1 ms)Preparing flush snapshotting stores in 3e47394b0fef67722b4a6bb63e40b67c at 1676127805741Finished memstore snapshotting hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127805741Flushing stores of hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. at 1676127805742 (+1 ms)Flushing 3e47394b0fef67722b4a6bb63e40b67c/info: creating writer at 1676127805742Flushing 3e47394b0fef67722b4a6bb63e40b67c/info: appending metadata at 1676127805745 (+3 ms)Flushing 3e47394b0fef67722b4a6bb63e40b67c/info: closing flushed file at 1676127805745Flushing 3e47394b0fef67722b4a6bb63e40b67c/info: reopening flushed file at 1676127805763 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 3e47394b0fef67722b4a6bb63e40b67c in 28ms, sequenceid=6, compaction requested=false at 1676127805768 (+5 ms)Writing region close event to WAL at 1676127805774 (+6 ms)Running coprocessor post-close hooks at 1676127805781 (+7 ms)Closed at 1676127805781 2023-02-11 15:03:25,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127803131.3e47394b0fef67722b4a6bb63e40b67c. 2023-02-11 15:03:25,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c34e40bd9da4d2088aa923a4350101a 2023-02-11 15:03:25,792 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/.tmp/table/45ea947039714a7cb4b88f9bea6fe276 2023-02-11 15:03:25,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45ea947039714a7cb4b88f9bea6fe276 2023-02-11 15:03:25,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/.tmp/info/4042741ba6524d688b15d554c43bb2e1 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/info/4042741ba6524d688b15d554c43bb2e1 2023-02-11 15:03:25,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4042741ba6524d688b15d554c43bb2e1 2023-02-11 15:03:25,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/info/4042741ba6524d688b15d554c43bb2e1, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 15:03:25,804 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/.tmp/rep_barrier/5c34e40bd9da4d2088aa923a4350101a as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/rep_barrier/5c34e40bd9da4d2088aa923a4350101a 2023-02-11 15:03:25,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c34e40bd9da4d2088aa923a4350101a 2023-02-11 15:03:25,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/rep_barrier/5c34e40bd9da4d2088aa923a4350101a, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 15:03:25,810 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/.tmp/table/45ea947039714a7cb4b88f9bea6fe276 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/table/45ea947039714a7cb4b88f9bea6fe276 2023-02-11 15:03:25,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45ea947039714a7cb4b88f9bea6fe276 2023-02-11 15:03:25,815 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/table/45ea947039714a7cb4b88f9bea6fe276, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 15:03:25,816 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 15:03:25,816 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 15:03:25,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false 2023-02-11 15:03:25,819 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 15:03:25,820 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:25,821 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:25,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:25,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127805740Running coprocessor pre-close hooks at 1676127805740Disabling compacts and flushes for region at 1676127805740Disabling writes for close at 1676127805741 (+1 ms)Obtaining lock to block concurrent updates at 1676127805741Preparing flush snapshotting stores in 1588230740 at 1676127805741Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676127805741Flushing stores of hbase:meta,,1.1588230740 at 1676127805742 (+1 ms)Flushing 1588230740/info: creating writer at 1676127805742Flushing 1588230740/info: appending metadata at 1676127805745 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676127805745Flushing 1588230740/rep_barrier: creating writer at 1676127805763 (+18 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676127805765 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676127805765Flushing 1588230740/table: creating writer at 1676127805784 (+19 ms)Flushing 1588230740/table: appending metadata at 1676127805786 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676127805786Flushing 1588230740/info: reopening flushed file at 1676127805798 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676127805805 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676127805811 (+6 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 75ms, sequenceid=21, compaction requested=false at 1676127805816 (+5 ms)Writing region close event to WAL at 1676127805817 (+1 ms)Running coprocessor post-close hooks at 1676127805820 (+3 ms)Closed at 1676127805821 (+1 ms) 2023-02-11 15:03:25,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:25,823 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:25,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 15:03:25,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 15:03:25,939 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38645,1676127802512; all regions closed. 2023-02-11 15:03:25,941 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40541,1676127802541; all regions closed. 2023-02-11 15:03:25,946 DEBUG [RS:0;jenkins-hbase4:38645] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/oldWALs 2023-02-11 15:03:25,946 INFO [RS:0;jenkins-hbase4:38645] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38645%2C1676127802512:(num 1676127803481) 2023-02-11 15:03:25,946 DEBUG [RS:0;jenkins-hbase4:38645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,946 INFO [RS:0;jenkins-hbase4:38645] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:25,947 DEBUG [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/oldWALs 2023-02-11 15:03:25,947 INFO [RS:0;jenkins-hbase4:38645] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:25,947 INFO [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40541%2C1676127802541.meta:.meta(num 1676127803066) 2023-02-11 15:03:25,947 INFO [RS:0;jenkins-hbase4:38645] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:25,947 INFO [RS:0;jenkins-hbase4:38645] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:25,947 INFO [RS:0;jenkins-hbase4:38645] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:25,947 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:25,948 INFO [RS:0;jenkins-hbase4:38645] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38645 2023-02-11 15:03:25,950 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:25,950 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,950 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38645,1676127802512 2023-02-11 15:03:25,951 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:25,950 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:25,951 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38645,1676127802512] 2023-02-11 15:03:25,951 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38645,1676127802512; numProcessing=1 2023-02-11 15:03:25,953 DEBUG [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/oldWALs 2023-02-11 15:03:25,953 INFO [RS:1;jenkins-hbase4:40541] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40541%2C1676127802541:(num 1676127803855) 2023-02-11 15:03:25,953 DEBUG [RS:1;jenkins-hbase4:40541] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,953 INFO [RS:1;jenkins-hbase4:40541] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:25,954 INFO [RS:1;jenkins-hbase4:40541] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:25,954 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38645,1676127802512 already deleted, retry=false 2023-02-11 15:03:25,954 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38645,1676127802512 expired; onlineServers=1 2023-02-11 15:03:25,955 INFO [RS:1;jenkins-hbase4:40541] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40541 2023-02-11 15:03:25,955 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:25,956 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:25,956 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40541,1676127802541 2023-02-11 15:03:25,956 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40541,1676127802541] 2023-02-11 15:03:25,957 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40541,1676127802541; numProcessing=2 2023-02-11 15:03:25,958 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40541,1676127802541 already deleted, retry=false 2023-02-11 15:03:25,958 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40541,1676127802541 expired; onlineServers=0 2023-02-11 15:03:25,958 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45403,1676127802463' ***** 2023-02-11 15:03:25,958 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:25,959 DEBUG [M:0;jenkins-hbase4:45403] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22ed2b55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:25,959 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45403,1676127802463 2023-02-11 15:03:25,959 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45403,1676127802463; all regions closed. 2023-02-11 15:03:25,959 DEBUG [M:0;jenkins-hbase4:45403] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:25,959 DEBUG [M:0;jenkins-hbase4:45403] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:25,959 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:25,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127802712] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127802712,5,FailOnTimeoutGroup] 2023-02-11 15:03:25,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127802708] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127802708,5,FailOnTimeoutGroup] 2023-02-11 15:03:25,959 DEBUG [M:0;jenkins-hbase4:45403] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:25,961 INFO [M:0;jenkins-hbase4:45403] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:25,961 INFO [M:0;jenkins-hbase4:45403] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:25,961 INFO [M:0;jenkins-hbase4:45403] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:25,961 DEBUG [M:0;jenkins-hbase4:45403] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:25,961 INFO [M:0;jenkins-hbase4:45403] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:25,961 ERROR [M:0;jenkins-hbase4:45403] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 15:03:25,961 INFO [M:0;jenkins-hbase4:45403] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:25,962 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:25,962 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:25,962 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:25,962 DEBUG [M:0;jenkins-hbase4:45403] zookeeper.ZKUtil(398): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:25,962 WARN [M:0;jenkins-hbase4:45403] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:25,962 INFO [M:0;jenkins-hbase4:45403] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:25,963 INFO [M:0;jenkins-hbase4:45403] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:25,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:25,963 DEBUG [M:0;jenkins-hbase4:45403] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:25,963 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:25,964 DEBUG [M:0;jenkins-hbase4:45403] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:25,964 DEBUG [M:0;jenkins-hbase4:45403] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:25,964 DEBUG [M:0;jenkins-hbase4:45403] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:25,964 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.92 KB heapSize=66.88 KB 2023-02-11 15:03:25,977 INFO [M:0;jenkins-hbase4:45403] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.92 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c02505153ff1433a92a7401bfce99474 2023-02-11 15:03:25,982 DEBUG [M:0;jenkins-hbase4:45403] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c02505153ff1433a92a7401bfce99474 as hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c02505153ff1433a92a7401bfce99474 2023-02-11 15:03:25,987 INFO [M:0;jenkins-hbase4:45403] regionserver.HStore(1080): Added hdfs://localhost:39295/user/jenkins/test-data/6853c47e-6853-a3ad-b207-c85b4326682e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c02505153ff1433a92a7401bfce99474, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 15:03:25,988 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegion(2947): Finished flush of dataSize ~55.92 KB/57260, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false 2023-02-11 15:03:25,988 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:25,989 DEBUG [M:0;jenkins-hbase4:45403] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127805963Disabling compacts and flushes for region at 1676127805963Disabling writes for close at 1676127805964 (+1 ms)Obtaining lock to block concurrent updates at 1676127805964Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127805964Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57260, getHeapSize=68464, getOffHeapSize=0, getCellsCount=145 at 1676127805964Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127805965 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127805965Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127805967 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127805968 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127805983 (+15 ms)Finished flush of dataSize ~55.92 KB/57260, heapSize ~66.86 KB/68464, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=132, compaction requested=false at 1676127805988 (+5 ms)Writing region close event to WAL at 1676127805988Closed at 1676127805988 2023-02-11 15:03:25,993 INFO [M:0;jenkins-hbase4:45403] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:25,993 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:25,993 INFO [M:0;jenkins-hbase4:45403] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45403 2023-02-11 15:03:25,995 DEBUG [M:0;jenkins-hbase4:45403] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45403,1676127802463 already deleted, retry=false 2023-02-11 15:03:26,135 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:26,135 INFO [M:0;jenkins-hbase4:45403] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45403,1676127802463; zookeeper connection closed. 2023-02-11 15:03:26,135 ERROR [Listener at localhost/39377-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dff7eaa rejected from java.util.concurrent.ThreadPoolExecutor@49c0f3cd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:26,136 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): master:45403-0x10043e87e100000, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:26,136 ERROR [Listener at localhost/39377-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b38f8c4 rejected from java.util.concurrent.ThreadPoolExecutor@49c0f3cd[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:26,235 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:26,235 INFO [RS:1;jenkins-hbase4:40541] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40541,1676127802541; zookeeper connection closed. 2023-02-11 15:03:26,235 ERROR [Listener at localhost/39377-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10bd59e9 rejected from java.util.concurrent.ThreadPoolExecutor@1482df26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:26,237 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40fd84c6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40fd84c6 2023-02-11 15:03:26,237 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:40541-0x10043e87e100002, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:26,237 ERROR [Listener at localhost/39377-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a1385b0 rejected from java.util.concurrent.ThreadPoolExecutor@1482df26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:26,336 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:26,336 INFO [RS:0;jenkins-hbase4:38645] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38645,1676127802512; zookeeper connection closed. 2023-02-11 15:03:26,336 ERROR [Listener at localhost/39377-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60c6ac70 rejected from java.util.concurrent.ThreadPoolExecutor@64f924b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:26,336 DEBUG [Listener at localhost/39377-EventThread] zookeeper.ZKWatcher(600): regionserver:38645-0x10043e87e100001, quorum=127.0.0.1:64097, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:26,336 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3925db91] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3925db91 2023-02-11 15:03:26,336 ERROR [Listener at localhost/39377-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@456092fb rejected from java.util.concurrent.ThreadPoolExecutor@64f924b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:26,336 INFO [Listener at localhost/39377] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:26,336 WARN [Listener at localhost/39377] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:26,340 INFO [Listener at localhost/39377] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:26,445 WARN [BP-1451322959-172.31.14.131-1676127801786 heartbeating to localhost/127.0.0.1:39295] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:26,445 WARN [BP-1451322959-172.31.14.131-1676127801786 heartbeating to localhost/127.0.0.1:39295] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1451322959-172.31.14.131-1676127801786 (Datanode Uuid e5a9ae76-d806-450d-851c-ba9fb3f0afd2) service to localhost/127.0.0.1:39295 2023-02-11 15:03:26,446 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/dfs/data/data3/current/BP-1451322959-172.31.14.131-1676127801786] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:26,447 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/dfs/data/data4/current/BP-1451322959-172.31.14.131-1676127801786] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:26,448 WARN [Listener at localhost/39377] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:26,451 INFO [Listener at localhost/39377] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:26,555 WARN [BP-1451322959-172.31.14.131-1676127801786 heartbeating to localhost/127.0.0.1:39295] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:26,556 WARN [BP-1451322959-172.31.14.131-1676127801786 heartbeating to localhost/127.0.0.1:39295] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1451322959-172.31.14.131-1676127801786 (Datanode Uuid b3f23fc7-73cd-4a13-9250-07d0b21b896b) service to localhost/127.0.0.1:39295 2023-02-11 15:03:26,557 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/dfs/data/data1/current/BP-1451322959-172.31.14.131-1676127801786] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:26,557 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/cluster_cd052888-97c1-2568-7204-2518aca11570/dfs/data/data2/current/BP-1451322959-172.31.14.131-1676127801786] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:26,568 INFO [Listener at localhost/39377] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:26,681 INFO [Listener at localhost/39377] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:26,702 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:26,715 INFO [Listener at localhost/39377] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 156) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39295 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39295 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/39377 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:39295 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39295 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39295 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:39295 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45403,1676127802463)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39295 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 534) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 262), ProcessCount=168 (was 169), AvailableMemoryMB=3974 (was 4019) 2023-02-11 15:03:26,725 INFO [Listener at localhost/39377] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=168, AvailableMemoryMB=3974 2023-02-11 15:03:26,742 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/hadoop.log.dir so I do NOT create it in target/test-data/a7585420-7f2a-2695-323f-acac12e69e23 2023-02-11 15:03:26,742 WARN [Listener at localhost/39377] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 15:03:26,742 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/hadoop.tmp.dir so I do NOT create it in target/test-data/a7585420-7f2a-2695-323f-acac12e69e23 2023-02-11 15:03:26,742 WARN [Listener at localhost/39377] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5bd06873-0983-a9e3-83da-190a235b6072/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 15:03:26,742 DEBUG [Listener at localhost/39377] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23 2023-02-11 15:03:26,742 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:03:26,742 INFO [Listener at localhost/39377] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08, deleteOnExit=true 2023-02-11 15:03:26,742 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:03:26,743 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/test.cache.data in system properties and HBase conf 2023-02-11 15:03:26,743 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:03:26,743 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:03:26,743 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:03:26,743 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:03:26,743 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:03:26,744 DEBUG [Listener at localhost/39377] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:03:26,744 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:26,744 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:26,744 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:03:26,744 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:03:26,745 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:26,746 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:03:26,746 INFO [Listener at localhost/39377] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:03:26,750 WARN [Listener at localhost/39377] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:26,751 WARN [Listener at localhost/39377] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:26,798 WARN [Listener at localhost/39377] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:26,800 INFO [Listener at localhost/39377] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:26,808 INFO [Listener at localhost/39377] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/java.io.tmpdir/Jetty_localhost_42745_hdfs____xhnskk/webapp 2023-02-11 15:03:26,907 INFO [Listener at localhost/39377] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42745 2023-02-11 15:03:26,912 WARN [Listener at localhost/39377] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:26,912 WARN [Listener at localhost/39377] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:26,958 WARN [Listener at localhost/34633] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:26,974 WARN [Listener at localhost/34633] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:26,976 WARN [Listener at localhost/34633] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:26,977 INFO [Listener at localhost/34633] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:26,986 INFO [Listener at localhost/34633] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/java.io.tmpdir/Jetty_localhost_36497_datanode____1n4n7a/webapp 2023-02-11 15:03:27,082 INFO [Listener at localhost/34633] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36497 2023-02-11 15:03:27,090 WARN [Listener at localhost/37095] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:27,106 WARN [Listener at localhost/37095] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:27,108 WARN [Listener at localhost/37095] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:27,110 INFO [Listener at localhost/37095] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:27,117 INFO [Listener at localhost/37095] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/java.io.tmpdir/Jetty_localhost_33673_datanode____.t3dfxj/webapp 2023-02-11 15:03:27,192 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c21530ee2a724f: Processing first storage report for DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650 from datanode 611007dc-3d1e-4142-bd33-78cc92fb4498 2023-02-11 15:03:27,192 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c21530ee2a724f: from storage DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650 node DatanodeRegistration(127.0.0.1:41379, datanodeUuid=611007dc-3d1e-4142-bd33-78cc92fb4498, infoPort=40951, infoSecurePort=0, ipcPort=37095, storageInfo=lv=-57;cid=testClusterID;nsid=1893946016;c=1676127806753), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:27,192 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c21530ee2a724f: Processing first storage report for DS-ffbe1991-a4a6-4d56-8ee3-52d2ba37b0a6 from datanode 611007dc-3d1e-4142-bd33-78cc92fb4498 2023-02-11 15:03:27,192 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c21530ee2a724f: from storage DS-ffbe1991-a4a6-4d56-8ee3-52d2ba37b0a6 node DatanodeRegistration(127.0.0.1:41379, datanodeUuid=611007dc-3d1e-4142-bd33-78cc92fb4498, infoPort=40951, infoSecurePort=0, ipcPort=37095, storageInfo=lv=-57;cid=testClusterID;nsid=1893946016;c=1676127806753), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:27,228 INFO [Listener at localhost/37095] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33673 2023-02-11 15:03:27,234 WARN [Listener at localhost/35071] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:27,336 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x54bc54698bd65bc2: Processing first storage report for DS-12e5645c-e315-4a8b-80a9-0d09fe38af40 from datanode 619f54d6-785b-47f6-936d-a21beef18ad5 2023-02-11 15:03:27,336 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x54bc54698bd65bc2: from storage DS-12e5645c-e315-4a8b-80a9-0d09fe38af40 node DatanodeRegistration(127.0.0.1:42041, datanodeUuid=619f54d6-785b-47f6-936d-a21beef18ad5, infoPort=42889, infoSecurePort=0, ipcPort=35071, storageInfo=lv=-57;cid=testClusterID;nsid=1893946016;c=1676127806753), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:27,337 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x54bc54698bd65bc2: Processing first storage report for DS-87f99a1b-0f90-4af5-abd8-e5c9b596d340 from datanode 619f54d6-785b-47f6-936d-a21beef18ad5 2023-02-11 15:03:27,337 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x54bc54698bd65bc2: from storage DS-87f99a1b-0f90-4af5-abd8-e5c9b596d340 node DatanodeRegistration(127.0.0.1:42041, datanodeUuid=619f54d6-785b-47f6-936d-a21beef18ad5, infoPort=42889, infoSecurePort=0, ipcPort=35071, storageInfo=lv=-57;cid=testClusterID;nsid=1893946016;c=1676127806753), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 15:03:27,343 DEBUG [Listener at localhost/35071] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23 2023-02-11 15:03:27,346 INFO [Listener at localhost/35071] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/zookeeper_0, clientPort=59327, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:03:27,347 INFO [Listener at localhost/35071] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59327 2023-02-11 15:03:27,347 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,348 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,367 INFO [Listener at localhost/35071] util.FSUtils(479): Created version file at hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a with version=8 2023-02-11 15:03:27,367 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,368 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,369 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/hbase-staging 2023-02-11 15:03:27,371 INFO [Listener at localhost/35071] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:27,371 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,371 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,371 INFO [Listener at localhost/35071] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:27,372 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,372 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:27,372 INFO [Listener at localhost/35071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:27,374 INFO [Listener at localhost/35071] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35867 2023-02-11 15:03:27,374 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,375 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,376 INFO [Listener at localhost/35071] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35867 connecting to ZooKeeper ensemble=127.0.0.1:59327 2023-02-11 15:03:27,386 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:358670x0, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:27,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35867-0x10043e891360000 connected 2023-02-11 15:03:27,415 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:27,415 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:27,416 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:27,418 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35867 2023-02-11 15:03:27,420 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35867 2023-02-11 15:03:27,420 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35867 2023-02-11 15:03:27,424 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35867 2023-02-11 15:03:27,424 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35867 2023-02-11 15:03:27,424 INFO [Listener at localhost/35071] master.HMaster(439): hbase.rootdir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a, hbase.cluster.distributed=false 2023-02-11 15:03:27,437 INFO [Listener at localhost/35071] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:27,437 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,438 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,438 INFO [Listener at localhost/35071] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:27,438 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,438 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:27,438 INFO [Listener at localhost/35071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:27,438 INFO [Listener at localhost/35071] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43987 2023-02-11 15:03:27,439 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:27,440 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:27,441 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,441 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,442 INFO [Listener at localhost/35071] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43987 connecting to ZooKeeper ensemble=127.0.0.1:59327 2023-02-11 15:03:27,446 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:439870x0, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:27,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43987-0x10043e891360001 connected 2023-02-11 15:03:27,447 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:27,448 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:27,448 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:27,452 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43987 2023-02-11 15:03:27,452 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43987 2023-02-11 15:03:27,452 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43987 2023-02-11 15:03:27,455 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43987 2023-02-11 15:03:27,455 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43987 2023-02-11 15:03:27,466 INFO [Listener at localhost/35071] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:27,466 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,467 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,467 INFO [Listener at localhost/35071] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:27,467 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:27,467 INFO [Listener at localhost/35071] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:27,467 INFO [Listener at localhost/35071] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:27,467 INFO [Listener at localhost/35071] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43213 2023-02-11 15:03:27,468 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:27,470 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:27,470 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,471 INFO [Listener at localhost/35071] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,472 INFO [Listener at localhost/35071] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43213 connecting to ZooKeeper ensemble=127.0.0.1:59327 2023-02-11 15:03:27,477 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:432130x0, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:27,478 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): regionserver:432130x0, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:27,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43213-0x10043e891360002 connected 2023-02-11 15:03:27,479 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:27,480 DEBUG [Listener at localhost/35071] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:27,481 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43213 2023-02-11 15:03:27,484 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43213 2023-02-11 15:03:27,485 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43213 2023-02-11 15:03:27,486 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43213 2023-02-11 15:03:27,486 DEBUG [Listener at localhost/35071] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43213 2023-02-11 15:03:27,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,488 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:27,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,491 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:27,491 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:27,491 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:27,491 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:27,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:27,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35867,1676127807371 from backup master directory 2023-02-11 15:03:27,494 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,494 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:27,494 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:27,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/hbase.id with ID: 424da97d-859b-4718-ae13-09314db28128 2023-02-11 15:03:27,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:27,522 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5225df96 to 127.0.0.1:59327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:27,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40323baf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:27,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:27,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:03:27,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:27,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store-tmp 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:27,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:27,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127807543Disabling compacts and flushes for region at 1676127807543Disabling writes for close at 1676127807543Writing region close event to WAL at 1676127807543Closed at 1676127807543 2023-02-11 15:03:27,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/WALs/jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35867%2C1676127807371, suffix=, logDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/WALs/jenkins-hbase4.apache.org,35867,1676127807371, archiveDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/oldWALs, maxLogs=10 2023-02-11 15:03:27,559 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK] 2023-02-11 15:03:27,560 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK] 2023-02-11 15:03:27,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/WALs/jenkins-hbase4.apache.org,35867,1676127807371/jenkins-hbase4.apache.org%2C35867%2C1676127807371.1676127807545 2023-02-11 15:03:27,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK], DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK]] 2023-02-11 15:03:27,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:27,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:27,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:27,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:27,572 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:27,573 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:03:27,574 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:03:27,574 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:27,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:27,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:27,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:27,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:27,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67180199, jitterRate=0.0010629743337631226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:27,580 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127807568Initializing all the Stores at 1676127807569 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127807569Cleaning up temporary data from old regions at 1676127807576 (+7 ms)Cleaning up detritus from prior splits at 1676127807576Region opened successfully at 1676127807580 (+4 ms) 2023-02-11 15:03:27,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:03:27,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:03:27,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:03:27,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:03:27,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 15:03:27,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 15:03:27,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:03:27,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:03:27,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:03:27,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:03:27,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:03:27,605 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:03:27,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:03:27,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:03:27,609 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,609 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:03:27,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:03:27,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:03:27,611 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:27,611 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:27,611 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,611 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:27,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35867,1676127807371, sessionid=0x10043e891360000, setting cluster-up flag (Was=false) 2023-02-11 15:03:27,616 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:03:27,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,624 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:03:27,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:27,629 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.hbase-snapshot/.tmp 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:27,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127837631 2023-02-11 15:03:27,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:03:27,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:03:27,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:03:27,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:03:27,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:03:27,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:03:27,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,635 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:27,636 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:03:27,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:03:27,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:03:27,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:03:27,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:03:27,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:03:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127807637,5,FailOnTimeoutGroup] 2023-02-11 15:03:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127807637,5,FailOnTimeoutGroup] 2023-02-11 15:03:27,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:03:27,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,637 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:27,650 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:27,651 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:27,651 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a 2023-02-11 15:03:27,659 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:27,660 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:27,661 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/info 2023-02-11 15:03:27,661 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:27,662 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:27,662 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:27,663 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:27,663 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:27,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:27,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:27,665 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/table 2023-02-11 15:03:27,666 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:27,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:27,667 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740 2023-02-11 15:03:27,667 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740 2023-02-11 15:03:27,669 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:27,670 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:27,672 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:27,672 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69494344, jitterRate=0.03554642200469971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:27,672 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127807659Initializing all the Stores at 1676127807659Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127807660 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127807660Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127807660Cleaning up temporary data from old regions at 1676127807668 (+8 ms)Cleaning up detritus from prior splits at 1676127807668Region opened successfully at 1676127807672 (+4 ms) 2023-02-11 15:03:27,672 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:27,672 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:27,672 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:27,672 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:27,672 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:27,673 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:27,673 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127807672Disabling compacts and flushes for region at 1676127807672Disabling writes for close at 1676127807672Writing region close event to WAL at 1676127807673 (+1 ms)Closed at 1676127807673 2023-02-11 15:03:27,673 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:27,673 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:03:27,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:03:27,675 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:03:27,676 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:03:27,694 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(952): ClusterId : 424da97d-859b-4718-ae13-09314db28128 2023-02-11 15:03:27,694 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(952): ClusterId : 424da97d-859b-4718-ae13-09314db28128 2023-02-11 15:03:27,694 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:27,694 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:27,696 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:27,696 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:27,696 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:27,697 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:27,698 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:27,700 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:27,700 DEBUG [RS:1;jenkins-hbase4:43213] zookeeper.ReadOnlyZKClient(139): Connect 0x5b82237f to 127.0.0.1:59327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:27,701 DEBUG [RS:0;jenkins-hbase4:43987] zookeeper.ReadOnlyZKClient(139): Connect 0x0f1afacf to 127.0.0.1:59327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:27,707 DEBUG [RS:1;jenkins-hbase4:43213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5545c67f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:27,707 DEBUG [RS:1;jenkins-hbase4:43213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@517a480f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:27,707 DEBUG [RS:0;jenkins-hbase4:43987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd155c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:27,708 DEBUG [RS:0;jenkins-hbase4:43987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e291bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:27,716 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43213 2023-02-11 15:03:27,716 INFO [RS:1;jenkins-hbase4:43213] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:27,716 INFO [RS:1;jenkins-hbase4:43213] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:27,716 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:27,717 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35867,1676127807371 with isa=jenkins-hbase4.apache.org/172.31.14.131:43213, startcode=1676127807466 2023-02-11 15:03:27,717 DEBUG [RS:1;jenkins-hbase4:43213] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:27,717 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43987 2023-02-11 15:03:27,717 INFO [RS:0;jenkins-hbase4:43987] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:27,717 INFO [RS:0;jenkins-hbase4:43987] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:27,717 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:27,718 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35867,1676127807371 with isa=jenkins-hbase4.apache.org/172.31.14.131:43987, startcode=1676127807437 2023-02-11 15:03:27,718 DEBUG [RS:0;jenkins-hbase4:43987] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:27,719 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40723, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:27,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,721 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43513, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:27,721 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a 2023-02-11 15:03:27,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,721 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34633 2023-02-11 15:03:27,722 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:27,722 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a 2023-02-11 15:03:27,722 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34633 2023-02-11 15:03:27,722 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:27,723 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:27,726 DEBUG [RS:1;jenkins-hbase4:43213] zookeeper.ZKUtil(162): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,726 WARN [RS:1;jenkins-hbase4:43213] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:27,726 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43213,1676127807466] 2023-02-11 15:03:27,726 INFO [RS:1;jenkins-hbase4:43213] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:27,726 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43987,1676127807437] 2023-02-11 15:03:27,726 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,726 DEBUG [RS:0;jenkins-hbase4:43987] zookeeper.ZKUtil(162): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,726 WARN [RS:0;jenkins-hbase4:43987] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:27,726 INFO [RS:0;jenkins-hbase4:43987] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:27,726 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,731 DEBUG [RS:1;jenkins-hbase4:43213] zookeeper.ZKUtil(162): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,732 DEBUG [RS:1;jenkins-hbase4:43213] zookeeper.ZKUtil(162): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,733 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:27,733 INFO [RS:1;jenkins-hbase4:43213] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:27,736 INFO [RS:1;jenkins-hbase4:43213] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:27,736 INFO [RS:1;jenkins-hbase4:43213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:27,736 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,740 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:27,741 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,741 DEBUG [RS:1;jenkins-hbase4:43213] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,749 DEBUG [RS:0;jenkins-hbase4:43987] zookeeper.ZKUtil(162): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,749 DEBUG [RS:0;jenkins-hbase4:43987] zookeeper.ZKUtil(162): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,750 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:27,750 INFO [RS:0;jenkins-hbase4:43987] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:27,752 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,752 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,752 INFO [RS:0;jenkins-hbase4:43987] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:27,753 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,753 INFO [RS:0;jenkins-hbase4:43987] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:27,753 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,756 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:27,757 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,757 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,758 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,758 DEBUG [RS:0;jenkins-hbase4:43987] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:27,760 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,760 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,760 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,765 INFO [RS:1;jenkins-hbase4:43213] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:27,765 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43213,1676127807466-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,770 INFO [RS:0;jenkins-hbase4:43987] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:27,770 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43987,1676127807437-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:27,775 INFO [RS:1;jenkins-hbase4:43213] regionserver.Replication(203): jenkins-hbase4.apache.org,43213,1676127807466 started 2023-02-11 15:03:27,775 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43213,1676127807466, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43213, sessionid=0x10043e891360002 2023-02-11 15:03:27,775 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:27,775 DEBUG [RS:1;jenkins-hbase4:43213] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,775 DEBUG [RS:1;jenkins-hbase4:43213] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43213,1676127807466' 2023-02-11 15:03:27,775 DEBUG [RS:1;jenkins-hbase4:43213] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:27,775 DEBUG [RS:1;jenkins-hbase4:43213] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43213,1676127807466' 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:27,776 DEBUG [RS:1;jenkins-hbase4:43213] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:27,776 INFO [RS:1;jenkins-hbase4:43213] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:27,776 INFO [RS:1;jenkins-hbase4:43213] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:27,781 INFO [RS:0;jenkins-hbase4:43987] regionserver.Replication(203): jenkins-hbase4.apache.org,43987,1676127807437 started 2023-02-11 15:03:27,781 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43987,1676127807437, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43987, sessionid=0x10043e891360001 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43987,1676127807437' 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:27,781 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:27,782 DEBUG [RS:0;jenkins-hbase4:43987] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,782 DEBUG [RS:0;jenkins-hbase4:43987] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43987,1676127807437' 2023-02-11 15:03:27,782 DEBUG [RS:0;jenkins-hbase4:43987] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:27,782 DEBUG [RS:0;jenkins-hbase4:43987] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:27,782 DEBUG [RS:0;jenkins-hbase4:43987] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:27,782 INFO [RS:0;jenkins-hbase4:43987] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:27,782 INFO [RS:0;jenkins-hbase4:43987] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:27,830 DEBUG [jenkins-hbase4:35867] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:03:27,830 DEBUG [jenkins-hbase4:35867] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:27,832 DEBUG [jenkins-hbase4:35867] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:27,832 DEBUG [jenkins-hbase4:35867] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:27,832 DEBUG [jenkins-hbase4:35867] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:27,833 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43987,1676127807437, state=OPENING 2023-02-11 15:03:27,834 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:03:27,835 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:27,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:27,835 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:27,989 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:27,990 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:27,991 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:27,995 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:03:27,995 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:27,997 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43987%2C1676127807437.meta, suffix=.meta, logDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43987,1676127807437, archiveDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/oldWALs, maxLogs=32 2023-02-11 15:03:28,013 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK] 2023-02-11 15:03:28,013 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK] 2023-02-11 15:03:28,015 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43987,1676127807437/jenkins-hbase4.apache.org%2C43987%2C1676127807437.meta.1676127807997.meta 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK], DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK]] 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:03:28,015 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:03:28,016 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:03:28,017 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:28,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/info 2023-02-11 15:03:28,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/info 2023-02-11 15:03:28,018 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:28,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:28,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:28,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:28,020 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:28,020 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:28,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:28,021 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:28,021 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/table 2023-02-11 15:03:28,021 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/table 2023-02-11 15:03:28,022 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:28,022 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:28,023 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740 2023-02-11 15:03:28,024 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740 2023-02-11 15:03:28,026 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:28,027 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:28,028 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58951617, jitterRate=-0.12155245244503021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:28,028 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127808016Writing region info on filesystem at 1676127808016Initializing all the Stores at 1676127808016Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127808016Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127808016Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127808016Cleaning up temporary data from old regions at 1676127808025 (+9 ms)Cleaning up detritus from prior splits at 1676127808026 (+1 ms)Running coprocessor post-open hooks at 1676127808028 (+2 ms)Region opened successfully at 1676127808028 2023-02-11 15:03:28,029 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127807989 2023-02-11 15:03:28,034 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:03:28,034 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:03:28,034 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43987,1676127807437, state=OPEN 2023-02-11 15:03:28,037 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:03:28,037 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:28,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:03:28,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43987,1676127807437 in 202 msec 2023-02-11 15:03:28,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:03:28,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-11 15:03:28,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 411 msec 2023-02-11 15:03:28,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127807489, completionTime=-1 2023-02-11 15:03:28,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:03:28,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:03:28,044 DEBUG [hconnection-0x130538b5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:28,046 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46706, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:28,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:03:28,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127868047 2023-02-11 15:03:28,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127928047 2023-02-11 15:03:28,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-11 15:03:28,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35867,1676127807371-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:28,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35867,1676127807371-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:28,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35867,1676127807371-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:28,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35867, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:28,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:28,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:03:28,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:28,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:03:28,054 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:03:28,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:28,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:28,056 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,057 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b empty. 2023-02-11 15:03:28,057 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,057 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:03:28,071 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:28,072 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4be4b15c7700072d8db21a1905df814b, NAME => 'hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,087 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,087 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4be4b15c7700072d8db21a1905df814b, disabling compactions & flushes 2023-02-11 15:03:28,087 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,087 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,087 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. after waiting 0 ms 2023-02-11 15:03:28,087 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,087 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,087 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4be4b15c7700072d8db21a1905df814b: Waiting for close lock at 1676127808087Disabling compacts and flushes for region at 1676127808087Disabling writes for close at 1676127808087Writing region close event to WAL at 1676127808087Closed at 1676127808087 2023-02-11 15:03:28,090 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:28,091 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127808091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808091"}]},"ts":"1676127808091"} 2023-02-11 15:03:28,094 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:28,095 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:28,095 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127808095"}]},"ts":"1676127808095"} 2023-02-11 15:03:28,097 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:28,101 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:28,101 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:28,101 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:28,101 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:28,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4be4b15c7700072d8db21a1905df814b, ASSIGN}] 2023-02-11 15:03:28,106 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4be4b15c7700072d8db21a1905df814b, ASSIGN 2023-02-11 15:03:28,106 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4be4b15c7700072d8db21a1905df814b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43213,1676127807466; forceNewPlan=false, retain=false 2023-02-11 15:03:28,257 INFO [jenkins-hbase4:35867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:28,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4be4b15c7700072d8db21a1905df814b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127808258"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808258"}]},"ts":"1676127808258"} 2023-02-11 15:03:28,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4be4b15c7700072d8db21a1905df814b, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:28,412 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,412 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:28,414 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48298, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:28,418 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43213%2C1676127807466, suffix=, logDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43213,1676127807466, archiveDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/oldWALs, maxLogs=32 2023-02-11 15:03:28,432 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK] 2023-02-11 15:03:28,432 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK] 2023-02-11 15:03:28,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43213,1676127807466/jenkins-hbase4.apache.org%2C43213%2C1676127807466.1676127808419 2023-02-11 15:03:28,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK], DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK]] 2023-02-11 15:03:28,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4be4b15c7700072d8db21a1905df814b, NAME => 'hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:28,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,436 INFO [StoreOpener-4be4b15c7700072d8db21a1905df814b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,437 DEBUG [StoreOpener-4be4b15c7700072d8db21a1905df814b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/info 2023-02-11 15:03:28,437 DEBUG [StoreOpener-4be4b15c7700072d8db21a1905df814b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/info 2023-02-11 15:03:28,438 INFO [StoreOpener-4be4b15c7700072d8db21a1905df814b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4be4b15c7700072d8db21a1905df814b columnFamilyName info 2023-02-11 15:03:28,438 INFO [StoreOpener-4be4b15c7700072d8db21a1905df814b-1] regionserver.HStore(310): Store=4be4b15c7700072d8db21a1905df814b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:28,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,439 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:28,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:28,445 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4be4b15c7700072d8db21a1905df814b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72315955, jitterRate=0.07759170234203339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:28,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4be4b15c7700072d8db21a1905df814b: Running coprocessor pre-open hook at 1676127808435Writing region info on filesystem at 1676127808435Initializing all the Stores at 1676127808436 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127808436Cleaning up temporary data from old regions at 1676127808440 (+4 ms)Cleaning up detritus from prior splits at 1676127808440Running coprocessor post-open hooks at 1676127808445 (+5 ms)Region opened successfully at 1676127808445 2023-02-11 15:03:28,445 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b., pid=6, masterSystemTime=1676127808412 2023-02-11 15:03:28,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:28,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4be4b15c7700072d8db21a1905df814b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127808450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127808450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127808450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127808450"}]},"ts":"1676127808450"} 2023-02-11 15:03:28,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:28,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4be4b15c7700072d8db21a1905df814b, server=jenkins-hbase4.apache.org,43213,1676127807466 in 192 msec 2023-02-11 15:03:28,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:28,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4be4b15c7700072d8db21a1905df814b, ASSIGN in 352 msec 2023-02-11 15:03:28,457 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:28,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127808457"}]},"ts":"1676127808457"} 2023-02-11 15:03:28,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:28,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:28,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 410 msec 2023-02-11 15:03:28,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:28,556 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:28,556 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:28,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:28,559 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:28,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:28,570 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:28,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-11 15:03:28,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:28,589 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:28,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-11 15:03:28,592 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:28,599 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:28,602 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.108sec 2023-02-11 15:03:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35867,1676127807371-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35867,1676127807371-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:28,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:28,689 DEBUG [Listener at localhost/35071] zookeeper.ReadOnlyZKClient(139): Connect 0x6fdcd978 to 127.0.0.1:59327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:28,694 DEBUG [Listener at localhost/35071] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22c6b7ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:28,695 DEBUG [hconnection-0x14c314f1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:28,697 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46708, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:28,698 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:28,698 DEBUG [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:28,700 DEBUG [Listener at localhost/35071] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:28,703 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40132, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:28,704 INFO [Listener at localhost/35071] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-11 15:03:28,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-11 15:03:28,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:28,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:40132 deadline: 1676127868704, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-11 15:03:28,705 INFO [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-11 15:03:28,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:28,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:28,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:28,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-11 15:03:28,710 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:28,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:28,717 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:28,717 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 empty. 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f empty. 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea empty. 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 empty. 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 empty. 2023-02-11 15:03:28,718 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 empty. 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 empty. 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 empty. 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 empty. 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:28,719 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:28,720 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c empty. 2023-02-11 15:03:28,720 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:28,720 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:28,720 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-11 15:03:28,728 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:28,730 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => cff6457cee34823c2ffa0c66615b5b0f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,730 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => da626f51f61ec776252bd8a862a71fc4, NAME => 'testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,730 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 00eb2ea629b1a4fa9f0272d183912403, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 00eb2ea629b1a4fa9f0272d183912403, disabling compactions & flushes 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,742 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing da626f51f61ec776252bd8a862a71fc4, disabling compactions & flushes 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:28,742 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. after waiting 0 ms 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:28,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. after waiting 0 ms 2023-02-11 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:28,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:28,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 00eb2ea629b1a4fa9f0272d183912403: Waiting for close lock at 1676127808742Disabling compacts and flushes for region at 1676127808742Disabling writes for close at 1676127808742Writing region close event to WAL at 1676127808743 (+1 ms)Closed at 1676127808743 2023-02-11 15:03:28,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for da626f51f61ec776252bd8a862a71fc4: Waiting for close lock at 1676127808742Disabling compacts and flushes for region at 1676127808742Disabling writes for close at 1676127808743 (+1 ms)Writing region close event to WAL at 1676127808743Closed at 1676127808743 2023-02-11 15:03:28,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 120c19ed9dc1ecaf084d33cf44413cc2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => b64a4091d79c43fcb24ccf56ddbc7eea, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing cff6457cee34823c2ffa0c66615b5b0f, disabling compactions & flushes 2023-02-11 15:03:28,744 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. after waiting 0 ms 2023-02-11 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:28,744 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:28,744 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for cff6457cee34823c2ffa0c66615b5b0f: Waiting for close lock at 1676127808744Disabling compacts and flushes for region at 1676127808744Disabling writes for close at 1676127808744Writing region close event to WAL at 1676127808744Closed at 1676127808744 2023-02-11 15:03:28,744 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => f6040f64131175d3b75e155d7c1b46f9, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 120c19ed9dc1ecaf084d33cf44413cc2, disabling compactions & flushes 2023-02-11 15:03:28,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:28,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:28,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. after waiting 0 ms 2023-02-11 15:03:28,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:28,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:28,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 120c19ed9dc1ecaf084d33cf44413cc2: Waiting for close lock at 1676127808754Disabling compacts and flushes for region at 1676127808754Disabling writes for close at 1676127808754Writing region close event to WAL at 1676127808754Closed at 1676127808754 2023-02-11 15:03:28,755 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9120d77fe203600a950807cc8b3fdbf6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing b64a4091d79c43fcb24ccf56ddbc7eea, disabling compactions & flushes 2023-02-11 15:03:28,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. after waiting 0 ms 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:28,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for b64a4091d79c43fcb24ccf56ddbc7eea: Waiting for close lock at 1676127808756Disabling compacts and flushes for region at 1676127808756Disabling writes for close at 1676127808756Writing region close event to WAL at 1676127808756Closed at 1676127808756 2023-02-11 15:03:28,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 91530d8340403e062bb1972454785b99, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing f6040f64131175d3b75e155d7c1b46f9, disabling compactions & flushes 2023-02-11 15:03:28,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. after waiting 0 ms 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:28,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:28,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for f6040f64131175d3b75e155d7c1b46f9: Waiting for close lock at 1676127808756Disabling compacts and flushes for region at 1676127808756Disabling writes for close at 1676127808756Writing region close event to WAL at 1676127808756Closed at 1676127808756 2023-02-11 15:03:28,757 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1731510a9f940bccd1171fd1b3f391a4, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,761 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,761 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 9120d77fe203600a950807cc8b3fdbf6, disabling compactions & flushes 2023-02-11 15:03:28,761 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:28,761 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:28,761 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. after waiting 0 ms 2023-02-11 15:03:28,761 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:28,761 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:28,761 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 9120d77fe203600a950807cc8b3fdbf6: Waiting for close lock at 1676127808761Disabling compacts and flushes for region at 1676127808761Disabling writes for close at 1676127808761Writing region close event to WAL at 1676127808761Closed at 1676127808761 2023-02-11 15:03:28,762 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => e94d50038e610e777074a3609c8bdf3c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp 2023-02-11 15:03:28,766 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,766 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 91530d8340403e062bb1972454785b99, disabling compactions & flushes 2023-02-11 15:03:28,767 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. after waiting 0 ms 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:28,767 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 91530d8340403e062bb1972454785b99: Waiting for close lock at 1676127808766Disabling compacts and flushes for region at 1676127808766Disabling writes for close at 1676127808767 (+1 ms)Writing region close event to WAL at 1676127808767Closed at 1676127808767 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 1731510a9f940bccd1171fd1b3f391a4, disabling compactions & flushes 2023-02-11 15:03:28,767 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. after waiting 0 ms 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:28,767 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:28,767 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 1731510a9f940bccd1171fd1b3f391a4: Waiting for close lock at 1676127808767Disabling compacts and flushes for region at 1676127808767Disabling writes for close at 1676127808767Writing region close event to WAL at 1676127808767Closed at 1676127808767 2023-02-11 15:03:28,769 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:28,770 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing e94d50038e610e777074a3609c8bdf3c, disabling compactions & flushes 2023-02-11 15:03:28,770 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:28,770 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:28,770 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. after waiting 0 ms 2023-02-11 15:03:28,770 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:28,770 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:28,770 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for e94d50038e610e777074a3609c8bdf3c: Waiting for close lock at 1676127808770Disabling compacts and flushes for region at 1676127808770Disabling writes for close at 1676127808770Writing region close event to WAL at 1676127808770Closed at 1676127808770 2023-02-11 15:03:28,772 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127808773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127808773"}]},"ts":"1676127808773"} 2023-02-11 15:03:28,775 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-11 15:03:28,776 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:28,776 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127808776"}]},"ts":"1676127808776"} 2023-02-11 15:03:28,777 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-11 15:03:28,781 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:28,783 INFO [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43987%2C1676127807437, suffix=, logDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43987,1676127807437, archiveDir=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/oldWALs, maxLogs=32 2023-02-11 15:03:28,787 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:28,787 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:28,787 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:28,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, ASSIGN}] 2023-02-11 15:03:28,790 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, ASSIGN 2023-02-11 15:03:28,790 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, ASSIGN 2023-02-11 15:03:28,790 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, ASSIGN 2023-02-11 15:03:28,790 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, ASSIGN 2023-02-11 15:03:28,790 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43987,1676127807437; forceNewPlan=false, retain=false 2023-02-11 15:03:28,791 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43213,1676127807466; forceNewPlan=false, retain=false 2023-02-11 15:03:28,791 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43213,1676127807466; forceNewPlan=false, retain=false 2023-02-11 15:03:28,791 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43213,1676127807466; forceNewPlan=false, retain=false 2023-02-11 15:03:28,792 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, ASSIGN 2023-02-11 15:03:28,792 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, ASSIGN 2023-02-11 15:03:28,792 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, ASSIGN 2023-02-11 15:03:28,792 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, ASSIGN 2023-02-11 15:03:28,792 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, ASSIGN 2023-02-11 15:03:28,792 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43213,1676127807466; forceNewPlan=false, retain=false 2023-02-11 15:03:28,792 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43987,1676127807437; forceNewPlan=false, retain=false 2023-02-11 15:03:28,793 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43987,1676127807437; forceNewPlan=false, retain=false 2023-02-11 15:03:28,792 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43213,1676127807466; forceNewPlan=false, retain=false 2023-02-11 15:03:28,792 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43987,1676127807437; forceNewPlan=false, retain=false 2023-02-11 15:03:28,793 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, ASSIGN 2023-02-11 15:03:28,793 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43987,1676127807437; forceNewPlan=false, retain=false 2023-02-11 15:03:28,798 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK] 2023-02-11 15:03:28,798 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK] 2023-02-11 15:03:28,800 INFO [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/WALs/jenkins-hbase4.apache.org,43987,1676127807437/jenkins-hbase4.apache.org%2C43987%2C1676127807437.1676127808784 2023-02-11 15:03:28,800 DEBUG [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42041,DS-12e5645c-e315-4a8b-80a9-0d09fe38af40,DISK], DatanodeInfoWithStorage[127.0.0.1:41379,DS-2439a5cc-32c6-4d78-bb7b-a9243f34d650,DISK]] 2023-02-11 15:03:28,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:28,941 INFO [jenkins-hbase4:35867] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-11 15:03:28,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e94d50038e610e777074a3609c8bdf3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:28,947 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=91530d8340403e062bb1972454785b99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:28,947 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127808947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808947"}]},"ts":"1676127808947"} 2023-02-11 15:03:28,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f6040f64131175d3b75e155d7c1b46f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:28,947 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=da626f51f61ec776252bd8a862a71fc4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:28,947 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=120c19ed9dc1ecaf084d33cf44413cc2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:28,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808947"}]},"ts":"1676127808947"} 2023-02-11 15:03:28,947 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808947"}]},"ts":"1676127808947"} 2023-02-11 15:03:28,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808947"}]},"ts":"1676127808947"} 2023-02-11 15:03:28,948 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127808947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808947"}]},"ts":"1676127808947"} 2023-02-11 15:03:28,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure e94d50038e610e777074a3609c8bdf3c, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:28,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure f6040f64131175d3b75e155d7c1b46f9, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:28,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=18, state=RUNNABLE; OpenRegionProcedure 91530d8340403e062bb1972454785b99, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:28,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 120c19ed9dc1ecaf084d33cf44413cc2, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:28,952 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9120d77fe203600a950807cc8b3fdbf6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,952 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808952"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808952"}]},"ts":"1676127808952"} 2023-02-11 15:03:28,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure da626f51f61ec776252bd8a862a71fc4, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:28,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=1731510a9f940bccd1171fd1b3f391a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,953 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808953"}]},"ts":"1676127808953"} 2023-02-11 15:03:28,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 9120d77fe203600a950807cc8b3fdbf6, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:28,955 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=cff6457cee34823c2ffa0c66615b5b0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,955 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808955"}]},"ts":"1676127808955"} 2023-02-11 15:03:28,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 1731510a9f940bccd1171fd1b3f391a4, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:28,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=00eb2ea629b1a4fa9f0272d183912403, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808955"}]},"ts":"1676127808955"} 2023-02-11 15:03:28,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure cff6457cee34823c2ffa0c66615b5b0f, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:28,957 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b64a4091d79c43fcb24ccf56ddbc7eea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:28,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127808957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127808957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127808957"}]},"ts":"1676127808957"} 2023-02-11 15:03:28,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 00eb2ea629b1a4fa9f0272d183912403, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:28,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure b64a4091d79c43fcb24ccf56ddbc7eea, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:29,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:29,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:29,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f6040f64131175d3b75e155d7c1b46f9, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-11 15:03:29,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,114 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,116 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1 2023-02-11 15:03:29,116 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1 2023-02-11 15:03:29,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:29,116 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6040f64131175d3b75e155d7c1b46f9 columnFamilyName f1 2023-02-11 15:03:29,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 00eb2ea629b1a4fa9f0272d183912403, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-11 15:03:29,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,117 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(310): Store=f6040f64131175d3b75e155d7c1b46f9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,117 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,118 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,118 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2 2023-02-11 15:03:29,118 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2 2023-02-11 15:03:29,118 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6040f64131175d3b75e155d7c1b46f9 columnFamilyName f2 2023-02-11 15:03:29,119 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1 2023-02-11 15:03:29,119 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(310): Store=f6040f64131175d3b75e155d7c1b46f9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,119 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1 2023-02-11 15:03:29,119 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00eb2ea629b1a4fa9f0272d183912403 columnFamilyName f1 2023-02-11 15:03:29,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,120 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(310): Store=00eb2ea629b1a4fa9f0272d183912403/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,120 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,121 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2 2023-02-11 15:03:29,121 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2 2023-02-11 15:03:29,121 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00eb2ea629b1a4fa9f0272d183912403 columnFamilyName f2 2023-02-11 15:03:29,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,122 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(310): Store=00eb2ea629b1a4fa9f0272d183912403/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f6040f64131175d3b75e155d7c1b46f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62295263, jitterRate=-0.07172824442386627}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f6040f64131175d3b75e155d7c1b46f9: Running coprocessor pre-open hook at 1676127809107Writing region info on filesystem at 1676127809107Initializing all the Stores at 1676127809114 (+7 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809114Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809114Cleaning up temporary data from old regions at 1676127809121 (+7 ms)Cleaning up detritus from prior splits at 1676127809121Running coprocessor post-open hooks at 1676127809125 (+4 ms)Region opened successfully at 1676127809125 2023-02-11 15:03:29,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9., pid=22, masterSystemTime=1676127809101 2023-02-11 15:03:29,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:29,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:29,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:29,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:29,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da626f51f61ec776252bd8a862a71fc4, NAME => 'testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-11 15:03:29,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f6040f64131175d3b75e155d7c1b46f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,128 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809128"}]},"ts":"1676127809128"} 2023-02-11 15:03:29,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,130 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 00eb2ea629b1a4fa9f0272d183912403; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63711337, jitterRate=-0.050627097487449646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 00eb2ea629b1a4fa9f0272d183912403: Running coprocessor pre-open hook at 1676127809117Writing region info on filesystem at 1676127809117Initializing all the Stores at 1676127809117Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809117Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809117Cleaning up temporary data from old regions at 1676127809123 (+6 ms)Cleaning up detritus from prior splits at 1676127809124 (+1 ms)Running coprocessor post-open hooks at 1676127809130 (+6 ms)Region opened successfully at 1676127809130 2023-02-11 15:03:29,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403., pid=29, masterSystemTime=1676127809106 2023-02-11 15:03:29,131 DEBUG [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f1 2023-02-11 15:03:29,131 DEBUG [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f1 2023-02-11 15:03:29,132 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da626f51f61ec776252bd8a862a71fc4 columnFamilyName f1 2023-02-11 15:03:29,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-11 15:03:29,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure f6040f64131175d3b75e155d7c1b46f9, server=jenkins-hbase4.apache.org,43987,1676127807437 in 180 msec 2023-02-11 15:03:29,132 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(310): Store=da626f51f61ec776252bd8a862a71fc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:29,132 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:29,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:29,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b64a4091d79c43fcb24ccf56ddbc7eea, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-11 15:03:29,133 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=00eb2ea629b1a4fa9f0272d183912403, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,133 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809133"}]},"ts":"1676127809133"} 2023-02-11 15:03:29,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,134 DEBUG [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f2 2023-02-11 15:03:29,134 DEBUG [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f2 2023-02-11 15:03:29,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, ASSIGN in 344 msec 2023-02-11 15:03:29,134 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da626f51f61ec776252bd8a862a71fc4 columnFamilyName f2 2023-02-11 15:03:29,134 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,135 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(310): Store=da626f51f61ec776252bd8a862a71fc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,136 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1 2023-02-11 15:03:29,136 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1 2023-02-11 15:03:29,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-11 15:03:29,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 00eb2ea629b1a4fa9f0272d183912403, server=jenkins-hbase4.apache.org,43213,1676127807466 in 177 msec 2023-02-11 15:03:29,136 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b64a4091d79c43fcb24ccf56ddbc7eea columnFamilyName f1 2023-02-11 15:03:29,137 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(310): Store=b64a4091d79c43fcb24ccf56ddbc7eea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,137 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, ASSIGN in 348 msec 2023-02-11 15:03:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,138 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2 2023-02-11 15:03:29,138 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2 2023-02-11 15:03:29,139 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b64a4091d79c43fcb24ccf56ddbc7eea columnFamilyName f2 2023-02-11 15:03:29,139 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(310): Store=b64a4091d79c43fcb24ccf56ddbc7eea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:29,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da626f51f61ec776252bd8a862a71fc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63568396, jitterRate=-0.052757084369659424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da626f51f61ec776252bd8a862a71fc4: Running coprocessor pre-open hook at 1676127809129Writing region info on filesystem at 1676127809129Initializing all the Stores at 1676127809129Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809129Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809129Cleaning up temporary data from old regions at 1676127809137 (+8 ms)Cleaning up detritus from prior splits at 1676127809137Running coprocessor post-open hooks at 1676127809142 (+5 ms)Region opened successfully at 1676127809142 2023-02-11 15:03:29,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4., pid=25, masterSystemTime=1676127809101 2023-02-11 15:03:29,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:29,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:29,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:29,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:29,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=da626f51f61ec776252bd8a862a71fc4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 120c19ed9dc1ecaf084d33cf44413cc2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-11 15:03:29,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127809145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809145"}]},"ts":"1676127809145"} 2023-02-11 15:03:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,148 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-11 15:03:29,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure da626f51f61ec776252bd8a862a71fc4, server=jenkins-hbase4.apache.org,43987,1676127807437 in 194 msec 2023-02-11 15:03:29,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b64a4091d79c43fcb24ccf56ddbc7eea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72934314, jitterRate=0.08680596947669983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b64a4091d79c43fcb24ccf56ddbc7eea: Running coprocessor pre-open hook at 1676127809133Writing region info on filesystem at 1676127809133Initializing all the Stores at 1676127809134 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809134Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809134Cleaning up temporary data from old regions at 1676127809142 (+8 ms)Cleaning up detritus from prior splits at 1676127809142Running coprocessor post-open hooks at 1676127809149 (+7 ms)Region opened successfully at 1676127809149 2023-02-11 15:03:29,149 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1 2023-02-11 15:03:29,150 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1 2023-02-11 15:03:29,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea., pid=30, masterSystemTime=1676127809106 2023-02-11 15:03:29,150 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c19ed9dc1ecaf084d33cf44413cc2 columnFamilyName f1 2023-02-11 15:03:29,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, ASSIGN in 361 msec 2023-02-11 15:03:29,151 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(310): Store=120c19ed9dc1ecaf084d33cf44413cc2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,151 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:29,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:29,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1731510a9f940bccd1171fd1b3f391a4, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-11 15:03:29,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b64a4091d79c43fcb24ccf56ddbc7eea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809152"}]},"ts":"1676127809152"} 2023-02-11 15:03:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,153 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2 2023-02-11 15:03:29,153 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2 2023-02-11 15:03:29,153 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c19ed9dc1ecaf084d33cf44413cc2 columnFamilyName f2 2023-02-11 15:03:29,154 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,154 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(310): Store=120c19ed9dc1ecaf084d33cf44413cc2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-11 15:03:29,155 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1 2023-02-11 15:03:29,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure b64a4091d79c43fcb24ccf56ddbc7eea, server=jenkins-hbase4.apache.org,43213,1676127807466 in 195 msec 2023-02-11 15:03:29,155 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1 2023-02-11 15:03:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,156 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1731510a9f940bccd1171fd1b3f391a4 columnFamilyName f1 2023-02-11 15:03:29,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, ASSIGN in 367 msec 2023-02-11 15:03:29,156 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(310): Store=1731510a9f940bccd1171fd1b3f391a4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,157 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,158 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2 2023-02-11 15:03:29,158 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2 2023-02-11 15:03:29,158 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1731510a9f940bccd1171fd1b3f391a4 columnFamilyName f2 2023-02-11 15:03:29,158 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(310): Store=1731510a9f940bccd1171fd1b3f391a4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:29,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 120c19ed9dc1ecaf084d33cf44413cc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68350839, jitterRate=0.018506869673728943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 120c19ed9dc1ecaf084d33cf44413cc2: Running coprocessor pre-open hook at 1676127809146Writing region info on filesystem at 1676127809146Initializing all the Stores at 1676127809147 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809147Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809148 (+1 ms)Cleaning up temporary data from old regions at 1676127809156 (+8 ms)Cleaning up detritus from prior splits at 1676127809157 (+1 ms)Running coprocessor post-open hooks at 1676127809161 (+4 ms)Region opened successfully at 1676127809161 2023-02-11 15:03:29,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2., pid=24, masterSystemTime=1676127809101 2023-02-11 15:03:29,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:29,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:29,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:29,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91530d8340403e062bb1972454785b99, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-11 15:03:29,164 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=120c19ed9dc1ecaf084d33cf44413cc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,164 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809164"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809164"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809164"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809164"}]},"ts":"1676127809164"} 2023-02-11 15:03:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-11 15:03:29,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 120c19ed9dc1ecaf084d33cf44413cc2, server=jenkins-hbase4.apache.org,43987,1676127807437 in 215 msec 2023-02-11 15:03:29,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, ASSIGN in 380 msec 2023-02-11 15:03:29,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,176 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1731510a9f940bccd1171fd1b3f391a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61087048, jitterRate=-0.08973205089569092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1731510a9f940bccd1171fd1b3f391a4: Running coprocessor pre-open hook at 1676127809152Writing region info on filesystem at 1676127809152Initializing all the Stores at 1676127809153 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809153Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809153Cleaning up temporary data from old regions at 1676127809160 (+7 ms)Cleaning up detritus from prior splits at 1676127809161 (+1 ms)Running coprocessor post-open hooks at 1676127809176 (+15 ms)Region opened successfully at 1676127809176 2023-02-11 15:03:29,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4., pid=27, masterSystemTime=1676127809106 2023-02-11 15:03:29,178 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1 2023-02-11 15:03:29,178 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1 2023-02-11 15:03:29,178 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91530d8340403e062bb1972454785b99 columnFamilyName f1 2023-02-11 15:03:29,179 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(310): Store=91530d8340403e062bb1972454785b99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,179 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,179 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=1731510a9f940bccd1171fd1b3f391a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,179 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809179"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809179"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809179"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809179"}]},"ts":"1676127809179"} 2023-02-11 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:29,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:29,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cff6457cee34823c2ffa0c66615b5b0f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-11 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,182 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2 2023-02-11 15:03:29,182 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2 2023-02-11 15:03:29,182 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91530d8340403e062bb1972454785b99 columnFamilyName f2 2023-02-11 15:03:29,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-11 15:03:29,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 1731510a9f940bccd1171fd1b3f391a4, server=jenkins-hbase4.apache.org,43213,1676127807466 in 226 msec 2023-02-11 15:03:29,183 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(310): Store=91530d8340403e062bb1972454785b99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, ASSIGN in 395 msec 2023-02-11 15:03:29,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,184 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,186 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1 2023-02-11 15:03:29,186 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1 2023-02-11 15:03:29,186 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cff6457cee34823c2ffa0c66615b5b0f columnFamilyName f1 2023-02-11 15:03:29,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,187 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(310): Store=cff6457cee34823c2ffa0c66615b5b0f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,187 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 91530d8340403e062bb1972454785b99 2023-02-11 15:03:29,189 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2 2023-02-11 15:03:29,189 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2 2023-02-11 15:03:29,189 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cff6457cee34823c2ffa0c66615b5b0f columnFamilyName f2 2023-02-11 15:03:29,190 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(310): Store=cff6457cee34823c2ffa0c66615b5b0f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 91530d8340403e062bb1972454785b99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67348567, jitterRate=0.0035718530416488647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 91530d8340403e062bb1972454785b99: Running coprocessor pre-open hook at 1676127809164Writing region info on filesystem at 1676127809164Initializing all the Stores at 1676127809166 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809166Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809176 (+10 ms)Cleaning up temporary data from old regions at 1676127809186 (+10 ms)Cleaning up detritus from prior splits at 1676127809186Running coprocessor post-open hooks at 1676127809190 (+4 ms)Region opened successfully at 1676127809190 2023-02-11 15:03:29,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99., pid=23, masterSystemTime=1676127809101 2023-02-11 15:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:29,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:29,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e94d50038e610e777074a3609c8bdf3c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-11 15:03:29,193 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=91530d8340403e062bb1972454785b99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,193 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809193"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809193"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809193"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809193"}]},"ts":"1676127809193"} 2023-02-11 15:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:29,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=18 2023-02-11 15:03:29,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=18, state=SUCCESS; OpenRegionProcedure 91530d8340403e062bb1972454785b99, server=jenkins-hbase4.apache.org,43987,1676127807437 in 244 msec 2023-02-11 15:03:29,198 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, ASSIGN in 409 msec 2023-02-11 15:03:29,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cff6457cee34823c2ffa0c66615b5b0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63068943, jitterRate=-0.06019951403141022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cff6457cee34823c2ffa0c66615b5b0f: Running coprocessor pre-open hook at 1676127809180Writing region info on filesystem at 1676127809180Initializing all the Stores at 1676127809181 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809181Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809184 (+3 ms)Cleaning up temporary data from old regions at 1676127809192 (+8 ms)Cleaning up detritus from prior splits at 1676127809192Running coprocessor post-open hooks at 1676127809199 (+7 ms)Region opened successfully at 1676127809199 2023-02-11 15:03:29,200 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f., pid=28, masterSystemTime=1676127809106 2023-02-11 15:03:29,201 DEBUG [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f1 2023-02-11 15:03:29,201 DEBUG [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f1 2023-02-11 15:03:29,201 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e94d50038e610e777074a3609c8bdf3c columnFamilyName f1 2023-02-11 15:03:29,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:29,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:29,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:29,202 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=cff6457cee34823c2ffa0c66615b5b0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9120d77fe203600a950807cc8b3fdbf6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-11 15:03:29,202 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809202"}]},"ts":"1676127809202"} 2023-02-11 15:03:29,202 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(310): Store=e94d50038e610e777074a3609c8bdf3c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,202 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:29,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,203 DEBUG [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f2 2023-02-11 15:03:29,203 DEBUG [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f2 2023-02-11 15:03:29,203 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,204 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e94d50038e610e777074a3609c8bdf3c columnFamilyName f2 2023-02-11 15:03:29,204 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(310): Store=e94d50038e610e777074a3609c8bdf3c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,205 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1 2023-02-11 15:03:29,205 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1 2023-02-11 15:03:29,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-11 15:03:29,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure cff6457cee34823c2ffa0c66615b5b0f, server=jenkins-hbase4.apache.org,43213,1676127807466 in 246 msec 2023-02-11 15:03:29,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,205 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9120d77fe203600a950807cc8b3fdbf6 columnFamilyName f1 2023-02-11 15:03:29,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,206 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(310): Store=9120d77fe203600a950807cc8b3fdbf6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,206 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, ASSIGN in 417 msec 2023-02-11 15:03:29,207 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2 2023-02-11 15:03:29,207 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2 2023-02-11 15:03:29,207 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9120d77fe203600a950807cc8b3fdbf6 columnFamilyName f2 2023-02-11 15:03:29,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,208 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(310): Store=9120d77fe203600a950807cc8b3fdbf6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:29,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:29,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e94d50038e610e777074a3609c8bdf3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63285362, jitterRate=-0.0569746196269989}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:29,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e94d50038e610e777074a3609c8bdf3c: Running coprocessor pre-open hook at 1676127809193Writing region info on filesystem at 1676127809193Initializing all the Stores at 1676127809195 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809195Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809196 (+1 ms)Cleaning up temporary data from old regions at 1676127809206 (+10 ms)Cleaning up detritus from prior splits at 1676127809207 (+1 ms)Running coprocessor post-open hooks at 1676127809211 (+4 ms)Region opened successfully at 1676127809211 2023-02-11 15:03:29,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c., pid=21, masterSystemTime=1676127809101 2023-02-11 15:03:29,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:29,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:29,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:29,213 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e94d50038e610e777074a3609c8bdf3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127809213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809213"}]},"ts":"1676127809213"} 2023-02-11 15:03:29,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:29,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9120d77fe203600a950807cc8b3fdbf6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74005877, jitterRate=0.1027735024690628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:29,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9120d77fe203600a950807cc8b3fdbf6: Running coprocessor pre-open hook at 1676127809202Writing region info on filesystem at 1676127809202Initializing all the Stores at 1676127809203 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809203Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127809203Cleaning up temporary data from old regions at 1676127809209 (+6 ms)Cleaning up detritus from prior splits at 1676127809210 (+1 ms)Running coprocessor post-open hooks at 1676127809215 (+5 ms)Region opened successfully at 1676127809215 2023-02-11 15:03:29,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6., pid=26, masterSystemTime=1676127809106 2023-02-11 15:03:29,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:29,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:29,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-11 15:03:29,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure e94d50038e610e777074a3609c8bdf3c, server=jenkins-hbase4.apache.org,43987,1676127807437 in 266 msec 2023-02-11 15:03:29,218 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=9120d77fe203600a950807cc8b3fdbf6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,218 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127809218"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127809218"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127809218"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127809218"}]},"ts":"1676127809218"} 2023-02-11 15:03:29,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, ASSIGN in 430 msec 2023-02-11 15:03:29,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-11 15:03:29,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 9120d77fe203600a950807cc8b3fdbf6, server=jenkins-hbase4.apache.org,43213,1676127807466 in 266 msec 2023-02-11 15:03:29,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-11 15:03:29,223 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, ASSIGN in 433 msec 2023-02-11 15:03:29,224 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:29,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127809224"}]},"ts":"1676127809224"} 2023-02-11 15:03:29,225 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-11 15:03:29,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:29,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 578 msec 2023-02-11 15:03:29,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:29,315 INFO [Listener at localhost/35071] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-11 15:03:29,315 DEBUG [Listener at localhost/35071] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-11 15:03:29,316 INFO [Listener at localhost/35071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:29,319 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-11 15:03:29,319 INFO [Listener at localhost/35071] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:29,319 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-11 15:03:29,319 INFO [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:29,362 DEBUG [hconnection-0x14c314f1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:29,368 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43987] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:29,373 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48320, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:29,379 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43213] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:29,452 INFO [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:29,452 INFO [Listener at localhost/35071] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:29,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 15:03:29,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127809454 (current time:1676127809454). 2023-02-11 15:03:29,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:29,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] zookeeper.ReadOnlyZKClient(139): Connect 0x6044168a to 127.0.0.1:59327 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:29,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bb89657, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:29,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:29,486 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46722, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6044168a to 127.0.0.1:59327 2023-02-11 15:03:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:29,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 15:03:29,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 15:03:29,490 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 15:03:29,491 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676128409491 2023-02-11 15:03:29,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-11 15:03:29,491 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,494 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:29,494 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:29,495 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-11 15:03:29,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 15:03:29,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 7 msec 2023-02-11 15:03:29,496 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 15:03:29,497 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676128409497 2023-02-11 15:03:29,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,509 INFO [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-11 15:03:29,509 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:29,510 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-11 15:03:29,510 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 15:03:29,543 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,543 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,589 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:29,589 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:29,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:29,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:29,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:29,589 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:29,590 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,590 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,591 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,591 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,591 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-11 15:03:29,591 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43213,1676127807466' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 15:03:29,594 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43987,1676127807437' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 15:03:29,594 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:29,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:29,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:29,596 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:29,643 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,643 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:29,643 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,643 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:29,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43987,1676127807437' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 15:03:29,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bbe9411[Count = 1] remaining members to acquire global barrier 2023-02-11 15:03:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:29,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:29,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43213,1676127807466' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 15:03:29,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bbe9411[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:29,649 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 15:03:29,649 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,713 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:29,713 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:29,713 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:29,713 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:29,713 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:29,713 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:29,713 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:29,713 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. started... 2023-02-11 15:03:29,714 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:29,713 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:29,714 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. started... 2023-02-11 15:03:29,714 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. started... 2023-02-11 15:03:29,713 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. started... 2023-02-11 15:03:29,717 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 15:03:29,717 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for da626f51f61ec776252bd8a862a71fc4: 2023-02-11 15:03:29,717 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-11 15:03:29,717 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:29,717 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f6040f64131175d3b75e155d7c1b46f9 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:29,717 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cff6457cee34823c2ffa0c66615b5b0f 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 15:03:29,717 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 00eb2ea629b1a4fa9f0272d183912403 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:29,717 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:29,717 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,717 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. started... 2023-02-11 15:03:29,718 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,717 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:29,719 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 120c19ed9dc1ecaf084d33cf44413cc2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:29,719 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:29,719 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. started... 2023-02-11 15:03:29,720 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:29,720 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1731510a9f940bccd1171fd1b3f391a4 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-11 15:03:29,720 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:29,744 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f1/45e34eca51894d8d8b6192ffdc14108d 2023-02-11 15:03:29,761 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f1/650ff66037b6465790d12e821e117671 2023-02-11 15:03:29,761 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f1/bea7bec40eac49a693c3347ea694f14a 2023-02-11 15:03:29,769 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f1/a20337bb3cf447efbdf14ff967538581 2023-02-11 15:03:29,769 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f1/d252c91fe4c74c8a890b2f8fd60cb60b 2023-02-11 15:03:29,785 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f2/87bc7d5f47874f049fcaa6cfda66aff5 2023-02-11 15:03:29,791 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f1/45e34eca51894d8d8b6192ffdc14108d as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/45e34eca51894d8d8b6192ffdc14108d 2023-02-11 15:03:29,795 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/45e34eca51894d8d8b6192ffdc14108d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:29,796 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:29,796 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f2/87bc7d5f47874f049fcaa6cfda66aff5 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/87bc7d5f47874f049fcaa6cfda66aff5 2023-02-11 15:03:29,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:29,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:29,797 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 15:03:29,807 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/87bc7d5f47874f049fcaa6cfda66aff5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:29,808 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for cff6457cee34823c2ffa0c66615b5b0f in 91ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,808 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-11 15:03:29,809 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cff6457cee34823c2ffa0c66615b5b0f: 2023-02-11 15:03:29,809 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,810 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,810 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/45e34eca51894d8d8b6192ffdc14108d] hfiles 2023-02-11 15:03:29,811 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/45e34eca51894d8d8b6192ffdc14108d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,811 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/87bc7d5f47874f049fcaa6cfda66aff5] hfiles 2023-02-11 15:03:29,811 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f2/856f41ef5ddc4e648287a21b0a4e2ab0 2023-02-11 15:03:29,811 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/87bc7d5f47874f049fcaa6cfda66aff5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,820 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f2/b0fa21ae6c904cbeb31757b003c42897 2023-02-11 15:03:29,823 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f1/650ff66037b6465790d12e821e117671 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/650ff66037b6465790d12e821e117671 2023-02-11 15:03:29,825 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f1/bea7bec40eac49a693c3347ea694f14a as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bea7bec40eac49a693c3347ea694f14a 2023-02-11 15:03:29,827 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/650ff66037b6465790d12e821e117671, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,828 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f2/c4ec757af94b413991391155d8847064 2023-02-11 15:03:29,828 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f2/856f41ef5ddc4e648287a21b0a4e2ab0 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/856f41ef5ddc4e648287a21b0a4e2ab0 2023-02-11 15:03:29,836 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f2/938e56d76f644fce9fab8e0ddc18c423 2023-02-11 15:03:29,838 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/856f41ef5ddc4e648287a21b0a4e2ab0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,839 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bea7bec40eac49a693c3347ea694f14a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,839 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f6040f64131175d3b75e155d7c1b46f9 in 122ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f6040f64131175d3b75e155d7c1b46f9: 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f2/b0fa21ae6c904cbeb31757b003c42897 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/b0fa21ae6c904cbeb31757b003c42897 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. completed. 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/650ff66037b6465790d12e821e117671] hfiles 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. started... 2023-02-11 15:03:29,841 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/650ff66037b6465790d12e821e117671 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,842 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b64a4091d79c43fcb24ccf56ddbc7eea 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:29,842 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/856f41ef5ddc4e648287a21b0a4e2ab0] hfiles 2023-02-11 15:03:29,841 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f1/a20337bb3cf447efbdf14ff967538581 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/a20337bb3cf447efbdf14ff967538581 2023-02-11 15:03:29,842 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/856f41ef5ddc4e648287a21b0a4e2ab0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,845 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f1/d252c91fe4c74c8a890b2f8fd60cb60b as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/d252c91fe4c74c8a890b2f8fd60cb60b 2023-02-11 15:03:29,847 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/b0fa21ae6c904cbeb31757b003c42897, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,847 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 120c19ed9dc1ecaf084d33cf44413cc2 in 128ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,847 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 120c19ed9dc1ecaf084d33cf44413cc2: 2023-02-11 15:03:29,848 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,848 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/a20337bb3cf447efbdf14ff967538581, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:29,848 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,848 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bea7bec40eac49a693c3347ea694f14a] hfiles 2023-02-11 15:03:29,848 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bea7bec40eac49a693c3347ea694f14a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,848 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/b0fa21ae6c904cbeb31757b003c42897] hfiles 2023-02-11 15:03:29,848 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/b0fa21ae6c904cbeb31757b003c42897 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,851 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f2/c4ec757af94b413991391155d8847064 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/c4ec757af94b413991391155d8847064 2023-02-11 15:03:29,853 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/d252c91fe4c74c8a890b2f8fd60cb60b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,853 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f2/938e56d76f644fce9fab8e0ddc18c423 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/938e56d76f644fce9fab8e0ddc18c423 2023-02-11 15:03:29,860 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. completed. 2023-02-11 15:03:29,860 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:29,860 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:29,860 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. started... 2023-02-11 15:03:29,860 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-11 15:03:29,861 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 91530d8340403e062bb1972454785b99 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:29,862 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/c4ec757af94b413991391155d8847064, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-11 15:03:29,863 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1731510a9f940bccd1171fd1b3f391a4 in 143ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,863 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1731510a9f940bccd1171fd1b3f391a4: 2023-02-11 15:03:29,863 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,863 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/938e56d76f644fce9fab8e0ddc18c423, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,863 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,863 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/a20337bb3cf447efbdf14ff967538581] hfiles 2023-02-11 15:03:29,864 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/a20337bb3cf447efbdf14ff967538581 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,864 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/c4ec757af94b413991391155d8847064] hfiles 2023-02-11 15:03:29,864 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/c4ec757af94b413991391155d8847064 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,864 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 00eb2ea629b1a4fa9f0272d183912403 in 147ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,864 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 00eb2ea629b1a4fa9f0272d183912403: 2023-02-11 15:03:29,865 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,865 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,865 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/d252c91fe4c74c8a890b2f8fd60cb60b] hfiles 2023-02-11 15:03:29,865 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/d252c91fe4c74c8a890b2f8fd60cb60b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,865 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/938e56d76f644fce9fab8e0ddc18c423] hfiles 2023-02-11 15:03:29,865 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/938e56d76f644fce9fab8e0ddc18c423 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,868 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f1/9a39ee9eaf4c483a9f5806c0be9d6936 2023-02-11 15:03:29,872 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. completed. 2023-02-11 15:03:29,872 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:29,872 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:29,872 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 15:03:29,872 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. started... 2023-02-11 15:03:29,881 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e94d50038e610e777074a3609c8bdf3c: 2023-02-11 15:03:29,881 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,881 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,881 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:29,881 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-11 15:03:29,892 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f1/d71fc6c6343243e2b1aab2b599ebccc9 2023-02-11 15:03:29,898 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f2/8dbbd7a3e9e343178e770f0363c09ccf 2023-02-11 15:03:29,903 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f1/9a39ee9eaf4c483a9f5806c0be9d6936 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/9a39ee9eaf4c483a9f5806c0be9d6936 2023-02-11 15:03:29,903 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. completed. 2023-02-11 15:03:29,903 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:29,903 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 15:03:29,907 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/9a39ee9eaf4c483a9f5806c0be9d6936, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,908 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f2/46c84f8dfc4f43379b0566176eaed66e 2023-02-11 15:03:29,908 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f2/8dbbd7a3e9e343178e770f0363c09ccf as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8dbbd7a3e9e343178e770f0363c09ccf 2023-02-11 15:03:29,912 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f1/d71fc6c6343243e2b1aab2b599ebccc9 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/d71fc6c6343243e2b1aab2b599ebccc9 2023-02-11 15:03:29,912 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8dbbd7a3e9e343178e770f0363c09ccf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,913 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b64a4091d79c43fcb24ccf56ddbc7eea in 71ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,913 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b64a4091d79c43fcb24ccf56ddbc7eea: 2023-02-11 15:03:29,913 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,913 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,913 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/9a39ee9eaf4c483a9f5806c0be9d6936] hfiles 2023-02-11 15:03:29,914 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/9a39ee9eaf4c483a9f5806c0be9d6936 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,914 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8dbbd7a3e9e343178e770f0363c09ccf] hfiles 2023-02-11 15:03:29,914 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8dbbd7a3e9e343178e770f0363c09ccf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,917 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/d71fc6c6343243e2b1aab2b599ebccc9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,917 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f2/46c84f8dfc4f43379b0566176eaed66e as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/46c84f8dfc4f43379b0566176eaed66e 2023-02-11 15:03:29,925 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/46c84f8dfc4f43379b0566176eaed66e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,926 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. completed. 2023-02-11 15:03:29,926 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:29,926 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:29,926 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-11 15:03:29,926 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. started... 2023-02-11 15:03:29,927 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9120d77fe203600a950807cc8b3fdbf6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-11 15:03:29,927 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 91530d8340403e062bb1972454785b99 in 66ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,927 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 91530d8340403e062bb1972454785b99: 2023-02-11 15:03:29,927 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,927 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,927 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/d71fc6c6343243e2b1aab2b599ebccc9] hfiles 2023-02-11 15:03:29,927 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/d71fc6c6343243e2b1aab2b599ebccc9 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,928 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/46c84f8dfc4f43379b0566176eaed66e] hfiles 2023-02-11 15:03:29,928 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/46c84f8dfc4f43379b0566176eaed66e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,933 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. completed. 2023-02-11 15:03:29,933 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:29,933 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 15:03:29,938 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f1/635174018f8345979ef4b7d8b2653021 2023-02-11 15:03:29,953 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f2/29b3499a856645c0924cf3fa90dfbdef 2023-02-11 15:03:29,956 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f1/635174018f8345979ef4b7d8b2653021 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/635174018f8345979ef4b7d8b2653021 2023-02-11 15:03:29,960 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/635174018f8345979ef4b7d8b2653021, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,961 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f2/29b3499a856645c0924cf3fa90dfbdef as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/29b3499a856645c0924cf3fa90dfbdef 2023-02-11 15:03:29,964 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/29b3499a856645c0924cf3fa90dfbdef, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-11 15:03:29,965 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9120d77fe203600a950807cc8b3fdbf6 in 38ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9120d77fe203600a950807cc8b3fdbf6: 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/635174018f8345979ef4b7d8b2653021] hfiles 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/635174018f8345979ef4b7d8b2653021 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/29b3499a856645c0924cf3fa90dfbdef] hfiles 2023-02-11 15:03:29,965 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/29b3499a856645c0924cf3fa90dfbdef for snapshot=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:29,971 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. completed. 2023-02-11 15:03:29,971 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:29,971 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-11 15:03:30,098 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:30,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:30,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:30,099 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-11 15:03:30,137 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. completed. 2023-02-11 15:03:30,137 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:30,137 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 15:03:30,137 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 15:03:30,137 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,137 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 15:03:30,137 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43987,1676127807437' in zk 2023-02-11 15:03:30,197 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,197 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 15:03:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:30,197 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:30,197 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 15:03:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43987,1676127807437': 2023-02-11 15:03:30,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43987,1676127807437' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 15:03:30,286 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. completed. 2023-02-11 15:03:30,286 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. completed. 2023-02-11 15:03:30,286 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:30,286 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:30,286 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-11 15:03:30,286 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-11 15:03:30,286 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-11 15:03:30,286 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,286 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 15:03:30,286 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43213,1676127807466' in zk 2023-02-11 15:03:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 15:03:30,351 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:30,351 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 15:03:30,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:30,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43213,1676127807466': 2023-02-11 15:03:30,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43213,1676127807466' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:30,356 INFO [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-11 15:03:30,356 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:30,356 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:30,356 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,356 INFO [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:30,398 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:30,398 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:30,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,398 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:30,399 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:30,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:30,399 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:30,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,401 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,401 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:30,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,600 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:30,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:30,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:30,602 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-11 15:03:30,628 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:30,628 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:30,628 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:30,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:30,628 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:30,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,628 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:30,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:30,628 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:30,629 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:30,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-11 15:03:31,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,094 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676127809491Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676127810628 (+1137 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676127810629 (+1 ms)Writing data manifest for testWithMockedMapReduceMultiRegion at 1676127810643 (+14 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676127810657 (+14 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676127811093 (+436 ms) 2023-02-11 15:03:31,095 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-11 15:03:31,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 1.6020 sec 2023-02-11 15:03:31,602 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:31,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:31,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:31,604 INFO [Listener at localhost/35071] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:31,607 INFO [Listener at localhost/35071] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:31,614 INFO [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:31,641 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43987] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:31,652 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43213] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:31,783 INFO [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:31,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:31,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,793 INFO [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-11 15:03:31,793 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:31,794 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-11 15:03:31,794 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-11 15:03:31,794 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,794 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,795 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:31,795 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:31,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:31,795 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:31,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:31,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:31,796 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,796 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,796 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:31,796 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:31,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-11 15:03:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-11 15:03:31,797 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:31,798 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 15:03:31,798 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-11 15:03:31,798 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:31,798 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. started... 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:31,798 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. started... 2023-02-11 15:03:31,799 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cff6457cee34823c2ffa0c66615b5b0f 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for da626f51f61ec776252bd8a862a71fc4: 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. started... 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. started... 2023-02-11 15:03:31,799 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f6040f64131175d3b75e155d7c1b46f9 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:31,799 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 00eb2ea629b1a4fa9f0272d183912403 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:31,799 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 15:03:31,799 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. started... 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. started... 2023-02-11 15:03:31,799 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-11 15:03:31,799 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1731510a9f940bccd1171fd1b3f391a4 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-11 15:03:31,799 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:31,799 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 91530d8340403e062bb1972454785b99 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:31,799 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:31,800 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 15:03:31,801 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. started... 2023-02-11 15:03:31,801 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 120c19ed9dc1ecaf084d33cf44413cc2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:31,841 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f1/836c2962789c4c5789ea7c4474e8df7e 2023-02-11 15:03:31,842 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f1/1d68ebddfece473ba598a2e913132cbe 2023-02-11 15:03:31,844 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f1/4ea1a1e121e042f3be64e56dad73661f 2023-02-11 15:03:31,845 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f1/5ff4b6f92427422da409b95a3b864324 2023-02-11 15:03:31,846 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f1/bc7998bb9f574a7a94ae367334a0d2b4 2023-02-11 15:03:31,846 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f1/0afa436207bb4ce794fc74466a96d0df 2023-02-11 15:03:31,895 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f2/d9a06a7f52d64920a43fdf47ed817fc1 2023-02-11 15:03:31,912 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f2/17cac2a5e107410f831361dfd665f61f 2023-02-11 15:03:31,913 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f2/aca84797fd464a2198939472a06c3da3 2023-02-11 15:03:31,914 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f2/a1ba518535ca450b8e8efcc11aa0d23e 2023-02-11 15:03:31,915 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f2/5ad9d407c8934834a2d3ba5cac3f7f5a 2023-02-11 15:03:31,919 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f1/836c2962789c4c5789ea7c4474e8df7e as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/836c2962789c4c5789ea7c4474e8df7e 2023-02-11 15:03:31,921 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f1/5ff4b6f92427422da409b95a3b864324 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/5ff4b6f92427422da409b95a3b864324 2023-02-11 15:03:31,922 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f1/4ea1a1e121e042f3be64e56dad73661f as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/4ea1a1e121e042f3be64e56dad73661f 2023-02-11 15:03:31,925 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f2/a23c47c5d86443898b4ed22e9c7c6b95 2023-02-11 15:03:31,926 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/836c2962789c4c5789ea7c4474e8df7e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,929 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/.tmp/f2/d9a06a7f52d64920a43fdf47ed817fc1 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/d9a06a7f52d64920a43fdf47ed817fc1 2023-02-11 15:03:31,929 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f1/bc7998bb9f574a7a94ae367334a0d2b4 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bc7998bb9f574a7a94ae367334a0d2b4 2023-02-11 15:03:31,929 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/4ea1a1e121e042f3be64e56dad73661f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,929 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f1/1d68ebddfece473ba598a2e913132cbe as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/1d68ebddfece473ba598a2e913132cbe 2023-02-11 15:03:31,930 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/5ff4b6f92427422da409b95a3b864324, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:31,931 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/.tmp/f2/aca84797fd464a2198939472a06c3da3 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/aca84797fd464a2198939472a06c3da3 2023-02-11 15:03:31,931 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/.tmp/f2/5ad9d407c8934834a2d3ba5cac3f7f5a as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/5ad9d407c8934834a2d3ba5cac3f7f5a 2023-02-11 15:03:31,935 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f1/0afa436207bb4ce794fc74466a96d0df as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/0afa436207bb4ce794fc74466a96d0df 2023-02-11 15:03:31,938 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/d9a06a7f52d64920a43fdf47ed817fc1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,940 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 00eb2ea629b1a4fa9f0272d183912403 in 141ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:31,940 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 00eb2ea629b1a4fa9f0272d183912403: 2023-02-11 15:03:31,940 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:31,941 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/aca84797fd464a2198939472a06c3da3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:31,941 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bc7998bb9f574a7a94ae367334a0d2b4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,942 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1731510a9f940bccd1171fd1b3f391a4 in 143ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:31,942 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/.tmp/f2/a1ba518535ca450b8e8efcc11aa0d23e as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/a1ba518535ca450b8e8efcc11aa0d23e 2023-02-11 15:03:31,942 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1731510a9f940bccd1171fd1b3f391a4: 2023-02-11 15:03:31,942 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:31,942 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:31,942 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. started... 2023-02-11 15:03:31,942 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b64a4091d79c43fcb24ccf56ddbc7eea 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:31,943 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-11 15:03:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 15:03:31,945 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/1d68ebddfece473ba598a2e913132cbe, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:31,943 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. started... 2023-02-11 15:03:31,945 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9120d77fe203600a950807cc8b3fdbf6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-11 15:03:31,945 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/5ad9d407c8934834a2d3ba5cac3f7f5a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,947 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/.tmp/f2/17cac2a5e107410f831361dfd665f61f as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/17cac2a5e107410f831361dfd665f61f 2023-02-11 15:03:31,948 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f6040f64131175d3b75e155d7c1b46f9 in 149ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:31,948 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f6040f64131175d3b75e155d7c1b46f9: 2023-02-11 15:03:31,948 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:31,948 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:31,948 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-11 15:03:31,948 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. started... 2023-02-11 15:03:31,948 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e94d50038e610e777074a3609c8bdf3c: 2023-02-11 15:03:31,949 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:31,949 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 15:03:31,949 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/0afa436207bb4ce794fc74466a96d0df, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,950 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/.tmp/f2/a23c47c5d86443898b4ed22e9c7c6b95 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/a23c47c5d86443898b4ed22e9c7c6b95 2023-02-11 15:03:31,950 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/a1ba518535ca450b8e8efcc11aa0d23e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,951 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 120c19ed9dc1ecaf084d33cf44413cc2 in 150ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:31,951 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 120c19ed9dc1ecaf084d33cf44413cc2: 2023-02-11 15:03:31,951 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:31,951 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 15:03:31,955 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/17cac2a5e107410f831361dfd665f61f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-11 15:03:31,956 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for cff6457cee34823c2ffa0c66615b5b0f in 157ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:31,956 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cff6457cee34823c2ffa0c66615b5b0f: 2023-02-11 15:03:31,956 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:31,956 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-11 15:03:31,957 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/a23c47c5d86443898b4ed22e9c7c6b95, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:31,957 INFO [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 91530d8340403e062bb1972454785b99 in 158ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:31,957 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 91530d8340403e062bb1972454785b99: 2023-02-11 15:03:31,957 DEBUG [rs(jenkins-hbase4.apache.org,43987,1676127807437)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:31,957 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 15:03:31,957 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 15:03:31,957 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:31,960 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 15:03:31,960 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43987,1676127807437' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 15:03:31,961 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:31,961 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:31,962 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,962 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:31,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:31,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:31,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43987,1676127807437' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 15:03:31,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f8117be[Count = 1] remaining members to acquire global barrier 2023-02-11 15:03:31,972 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f1/979312762f504fb8bc9bf763cfa30bee 2023-02-11 15:03:31,974 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f1/aab61e21b5154a7ca34b461cea7130e0 2023-02-11 15:03:31,993 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f2/d57e5ed36e1f4f6cafa9d8ba4d425010 2023-02-11 15:03:31,996 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f2/8fafa1cd0bba4a48b3cbe63d3032d98b 2023-02-11 15:03:32,001 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f1/979312762f504fb8bc9bf763cfa30bee as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/979312762f504fb8bc9bf763cfa30bee 2023-02-11 15:03:32,005 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f1/aab61e21b5154a7ca34b461cea7130e0 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/aab61e21b5154a7ca34b461cea7130e0 2023-02-11 15:03:32,006 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/979312762f504fb8bc9bf763cfa30bee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:32,007 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/.tmp/f2/d57e5ed36e1f4f6cafa9d8ba4d425010 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/d57e5ed36e1f4f6cafa9d8ba4d425010 2023-02-11 15:03:32,012 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/d57e5ed36e1f4f6cafa9d8ba4d425010, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:32,013 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/aab61e21b5154a7ca34b461cea7130e0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:32,013 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9120d77fe203600a950807cc8b3fdbf6 in 68ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:32,013 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9120d77fe203600a950807cc8b3fdbf6: 2023-02-11 15:03:32,013 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:32,013 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-11 15:03:32,013 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/.tmp/f2/8fafa1cd0bba4a48b3cbe63d3032d98b as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8fafa1cd0bba4a48b3cbe63d3032d98b 2023-02-11 15:03:32,030 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8fafa1cd0bba4a48b3cbe63d3032d98b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-11 15:03:32,031 INFO [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b64a4091d79c43fcb24ccf56ddbc7eea in 89ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:32,031 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b64a4091d79c43fcb24ccf56ddbc7eea: 2023-02-11 15:03:32,031 DEBUG [rs(jenkins-hbase4.apache.org,43213,1676127807466)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-11 15:03:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-11 15:03:32,031 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,032 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-11 15:03:32,032 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43213,1676127807466' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-11 15:03:32,033 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,033 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,034 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:32,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:32,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:32,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43213,1676127807466' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-11 15:03:32,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f8117be[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:32,036 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-11 15:03:32,036 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,038 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:32,038 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 15:03:32,038 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-11 15:03:32,038 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-11 15:03:32,038 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43213,1676127807466' in zk 2023-02-11 15:03:32,038 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,038 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43987,1676127807437' in zk 2023-02-11 15:03:32,039 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,039 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:32,040 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 15:03:32,040 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,040 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:32,040 DEBUG [member: 'jenkins-hbase4.apache.org,43213,1676127807466' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 15:03:32,041 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,041 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-11 15:03:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:32,041 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:32,041 DEBUG [member: 'jenkins-hbase4.apache.org,43987,1676127807437' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-11 15:03:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43213,1676127807466': 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43213,1676127807466' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:32,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43987,1676127807437': 2023-02-11 15:03:32,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43987,1676127807437' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:32,046 INFO [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-11 15:03:32,046 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:32,046 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:32,046 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,046 INFO [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:32,047 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,047 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:32,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:32,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,047 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,047 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:32,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,048 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:32,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:32,048 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:32,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:32,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:32,048 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:32,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:32,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,050 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:32,050 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:32,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:32,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-11 15:03:32,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:32,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:32,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:32,054 DEBUG [(jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:32,054 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:32,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:32,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:32,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:32,055 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,055 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:32,155 DEBUG [Listener at localhost/35071] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:32,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:32,161 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676127809454 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:32,162 DEBUG [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: 91530d8340403e062bb1972454785b99 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:32,162 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(239): region to add: e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=cff6457cee34823c2ffa0c66615b5b0f as cff6457cee34823c2ffa0c66615b5b0f in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=00eb2ea629b1a4fa9f0272d183912403 as 00eb2ea629b1a4fa9f0272d183912403 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=da626f51f61ec776252bd8a862a71fc4 as da626f51f61ec776252bd8a862a71fc4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=f6040f64131175d3b75e155d7c1b46f9 as f6040f64131175d3b75e155d7c1b46f9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=120c19ed9dc1ecaf084d33cf44413cc2 as 120c19ed9dc1ecaf084d33cf44413cc2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=1731510a9f940bccd1171fd1b3f391a4 as 1731510a9f940bccd1171fd1b3f391a4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=91530d8340403e062bb1972454785b99 as 91530d8340403e062bb1972454785b99 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=b64a4091d79c43fcb24ccf56ddbc7eea as b64a4091d79c43fcb24ccf56ddbc7eea in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=9120d77fe203600a950807cc8b3fdbf6 as 9120d77fe203600a950807cc8b3fdbf6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,163 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(585): clone region=e94d50038e610e777074a3609c8bdf3c as e94d50038e610e777074a3609c8bdf3c in snapshot testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,164 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => f6040f64131175d3b75e155d7c1b46f9, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,165 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 00eb2ea629b1a4fa9f0272d183912403, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,165 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 120c19ed9dc1ecaf084d33cf44413cc2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,165 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => da626f51f61ec776252bd8a862a71fc4, NAME => 'testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,165 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cff6457cee34823c2ffa0c66615b5b0f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,172 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 1731510a9f940bccd1171fd1b3f391a4, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,172 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 91530d8340403e062bb1972454785b99, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,174 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => b64a4091d79c43fcb24ccf56ddbc7eea, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,216 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,217 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing da626f51f61ec776252bd8a862a71fc4, disabling compactions & flushes 2023-02-11 15:03:32,217 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:32,217 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:32,217 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. after waiting 0 ms 2023-02-11 15:03:32,217 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:32,217 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:32,217 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for da626f51f61ec776252bd8a862a71fc4: Waiting for close lock at 1676127812217Disabling compacts and flushes for region at 1676127812217Disabling writes for close at 1676127812217Writing region close event to WAL at 1676127812217Closed at 1676127812217 2023-02-11 15:03:32,217 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9120d77fe203600a950807cc8b3fdbf6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,229 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,229 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d252c91fe4c74c8a890b2f8fd60cb60b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,235 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,235 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a20337bb3cf447efbdf14ff967538581 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,236 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,236 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 45e34eca51894d8d8b6192ffdc14108d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,240 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c4ec757af94b413991391155d8847064 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,244 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 938e56d76f644fce9fab8e0ddc18c423 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,247 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 87bc7d5f47874f049fcaa6cfda66aff5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,247 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,247 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d71fc6c6343243e2b1aab2b599ebccc9 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,253 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,253 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9a39ee9eaf4c483a9f5806c0be9d6936 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,253 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 1731510a9f940bccd1171fd1b3f391a4, disabling compactions & flushes 2023-02-11 15:03:32,253 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:32,254 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:32,254 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. after waiting 0 ms 2023-02-11 15:03:32,254 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:32,254 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:32,254 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 1731510a9f940bccd1171fd1b3f391a4: Waiting for close lock at 1676127812253Disabling compacts and flushes for region at 1676127812253Disabling writes for close at 1676127812254 (+1 ms)Writing region close event to WAL at 1676127812254Closed at 1676127812254 2023-02-11 15:03:32,254 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => e94d50038e610e777074a3609c8bdf3c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,255 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cff6457cee34823c2ffa0c66615b5b0f, disabling compactions & flushes 2023-02-11 15:03:32,255 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:32,255 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:32,255 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. after waiting 0 ms 2023-02-11 15:03:32,255 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:32,255 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:32,255 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cff6457cee34823c2ffa0c66615b5b0f: Waiting for close lock at 1676127812255Disabling compacts and flushes for region at 1676127812255Disabling writes for close at 1676127812255Writing region close event to WAL at 1676127812255Closed at 1676127812255 2023-02-11 15:03:32,255 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46c84f8dfc4f43379b0566176eaed66e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,256 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8dbbd7a3e9e343178e770f0363c09ccf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,256 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 00eb2ea629b1a4fa9f0272d183912403, disabling compactions & flushes 2023-02-11 15:03:32,257 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,257 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:32,257 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bea7bec40eac49a693c3347ea694f14a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,257 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:32,257 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. after waiting 0 ms 2023-02-11 15:03:32,257 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:32,257 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:32,257 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 00eb2ea629b1a4fa9f0272d183912403: Waiting for close lock at 1676127812256Disabling compacts and flushes for region at 1676127812256Disabling writes for close at 1676127812257 (+1 ms)Writing region close event to WAL at 1676127812257Closed at 1676127812257 2023-02-11 15:03:32,265 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,265 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 635174018f8345979ef4b7d8b2653021 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,266 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b0fa21ae6c904cbeb31757b003c42897 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,266 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing b64a4091d79c43fcb24ccf56ddbc7eea, disabling compactions & flushes 2023-02-11 15:03:32,266 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:32,266 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:32,266 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. after waiting 0 ms 2023-02-11 15:03:32,266 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:32,266 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:32,267 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for b64a4091d79c43fcb24ccf56ddbc7eea: Waiting for close lock at 1676127812266Disabling compacts and flushes for region at 1676127812266Disabling writes for close at 1676127812266Writing region close event to WAL at 1676127812266Closed at 1676127812266 2023-02-11 15:03:32,267 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 91530d8340403e062bb1972454785b99, disabling compactions & flushes 2023-02-11 15:03:32,267 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:32,267 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:32,267 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. after waiting 0 ms 2023-02-11 15:03:32,267 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:32,267 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:32,267 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 91530d8340403e062bb1972454785b99: Waiting for close lock at 1676127812267Disabling compacts and flushes for region at 1676127812267Disabling writes for close at 1676127812267Writing region close event to WAL at 1676127812267Closed at 1676127812267 2023-02-11 15:03:32,269 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,270 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing e94d50038e610e777074a3609c8bdf3c, disabling compactions & flushes 2023-02-11 15:03:32,270 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:32,270 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:32,270 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. after waiting 0 ms 2023-02-11 15:03:32,270 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:32,270 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:32,270 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for e94d50038e610e777074a3609c8bdf3c: Waiting for close lock at 1676127812270Disabling compacts and flushes for region at 1676127812270Disabling writes for close at 1676127812270Writing region close event to WAL at 1676127812270Closed at 1676127812270 2023-02-11 15:03:32,270 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 29b3499a856645c0924cf3fa90dfbdef from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,271 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 120c19ed9dc1ecaf084d33cf44413cc2, disabling compactions & flushes 2023-02-11 15:03:32,271 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:32,271 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:32,271 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. after waiting 0 ms 2023-02-11 15:03:32,271 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:32,271 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:32,271 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 120c19ed9dc1ecaf084d33cf44413cc2: Waiting for close lock at 1676127812271Disabling compacts and flushes for region at 1676127812271Disabling writes for close at 1676127812271Writing region close event to WAL at 1676127812271Closed at 1676127812271 2023-02-11 15:03:32,272 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 9120d77fe203600a950807cc8b3fdbf6, disabling compactions & flushes 2023-02-11 15:03:32,273 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:32,273 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:32,273 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. after waiting 0 ms 2023-02-11 15:03:32,273 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:32,273 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:32,273 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 9120d77fe203600a950807cc8b3fdbf6: Waiting for close lock at 1676127812272Disabling compacts and flushes for region at 1676127812272Disabling writes for close at 1676127812273 (+1 ms)Writing region close event to WAL at 1676127812273Closed at 1676127812273 2023-02-11 15:03:32,658 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:32,658 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 650ff66037b6465790d12e821e117671 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,660 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 856f41ef5ddc4e648287a21b0a4e2ab0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:32,662 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing f6040f64131175d3b75e155d7c1b46f9, disabling compactions & flushes 2023-02-11 15:03:32,662 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:32,662 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:32,662 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. after waiting 0 ms 2023-02-11 15:03:32,662 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:32,662 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:32,662 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for f6040f64131175d3b75e155d7c1b46f9: Waiting for close lock at 1676127812662Disabling compacts and flushes for region at 1676127812662Disabling writes for close at 1676127812662Writing region close event to WAL at 1676127812662Closed at 1676127812662 2023-02-11 15:03:32,663 INFO [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676127809454 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:32,663 DEBUG [Listener at localhost/35071] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,663 DEBUG [Listener at localhost/35071] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6 2023-02-11 15:03:32,663 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:32,664 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:32,664 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-11 15:03:32,665 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------00eb2ea629b1a4fa9f0272d183912403/ 2023-02-11 15:03:32,665 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,665 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,665 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=00eb2ea629b1a4fa9f0272d183912403-d252c91fe4c74c8a890b2f8fd60cb60b 2023-02-11 15:03:32,666 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,666 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=00eb2ea629b1a4fa9f0272d183912403-938e56d76f644fce9fab8e0ddc18c423 2023-02-11 15:03:32,666 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------120c19ed9dc1ecaf084d33cf44413cc2/ 2023-02-11 15:03:32,666 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,666 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,667 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=120c19ed9dc1ecaf084d33cf44413cc2-bea7bec40eac49a693c3347ea694f14a 2023-02-11 15:03:32,667 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,667 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=120c19ed9dc1ecaf084d33cf44413cc2-b0fa21ae6c904cbeb31757b003c42897 2023-02-11 15:03:32,667 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------1731510a9f940bccd1171fd1b3f391a4/ 2023-02-11 15:03:32,667 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,668 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,668 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1731510a9f940bccd1171fd1b3f391a4-a20337bb3cf447efbdf14ff967538581 2023-02-11 15:03:32,668 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,668 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1731510a9f940bccd1171fd1b3f391a4-c4ec757af94b413991391155d8847064 2023-02-11 15:03:32,668 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------9120d77fe203600a950807cc8b3fdbf6/ 2023-02-11 15:03:32,669 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,669 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,669 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9120d77fe203600a950807cc8b3fdbf6-635174018f8345979ef4b7d8b2653021 2023-02-11 15:03:32,669 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,669 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9120d77fe203600a950807cc8b3fdbf6-29b3499a856645c0924cf3fa90dfbdef 2023-02-11 15:03:32,669 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------91530d8340403e062bb1972454785b99/ 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=91530d8340403e062bb1972454785b99-d71fc6c6343243e2b1aab2b599ebccc9 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=91530d8340403e062bb1972454785b99-46c84f8dfc4f43379b0566176eaed66e 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------b64a4091d79c43fcb24ccf56ddbc7eea/ 2023-02-11 15:03:32,670 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,671 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,671 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b64a4091d79c43fcb24ccf56ddbc7eea-9a39ee9eaf4c483a9f5806c0be9d6936 2023-02-11 15:03:32,671 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,671 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=b64a4091d79c43fcb24ccf56ddbc7eea-8dbbd7a3e9e343178e770f0363c09ccf 2023-02-11 15:03:32,671 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------cff6457cee34823c2ffa0c66615b5b0f/ 2023-02-11 15:03:32,671 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,672 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,672 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cff6457cee34823c2ffa0c66615b5b0f-45e34eca51894d8d8b6192ffdc14108d 2023-02-11 15:03:32,672 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,672 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cff6457cee34823c2ffa0c66615b5b0f-87bc7d5f47874f049fcaa6cfda66aff5 2023-02-11 15:03:32,672 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------da626f51f61ec776252bd8a862a71fc4/ 2023-02-11 15:03:32,672 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,673 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------e94d50038e610e777074a3609c8bdf3c/ 2023-02-11 15:03:32,673 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,673 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |----------f6040f64131175d3b75e155d7c1b46f9/ 2023-02-11 15:03:32,673 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:32,673 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:32,673 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f6040f64131175d3b75e155d7c1b46f9-650ff66037b6465790d12e821e117671 2023-02-11 15:03:32,674 DEBUG [Listener at localhost/35071] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:32,674 DEBUG [Listener at localhost/35071] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=f6040f64131175d3b75e155d7c1b46f9-856f41ef5ddc4e648287a21b0a4e2ab0 2023-02-11 15:03:32,677 INFO [Listener at localhost/35071] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 15:03:33,326 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,326 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,327 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,330 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:33,331 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1 2023-02-11 15:03:33,331 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c19ed9dc1ecaf084d33cf44413cc2 columnFamilyName f1 2023-02-11 15:03:33,338 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/testWithMockedMapReduceMultiRegion=120c19ed9dc1ecaf084d33cf44413cc2-bea7bec40eac49a693c3347ea694f14a 2023-02-11 15:03:33,338 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(310): Store=120c19ed9dc1ecaf084d33cf44413cc2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,338 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:33,339 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2 2023-02-11 15:03:33,339 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 120c19ed9dc1ecaf084d33cf44413cc2 columnFamilyName f2 2023-02-11 15:03:33,343 DEBUG [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/testWithMockedMapReduceMultiRegion=120c19ed9dc1ecaf084d33cf44413cc2-b0fa21ae6c904cbeb31757b003c42897 2023-02-11 15:03:33,343 INFO [StoreOpener-120c19ed9dc1ecaf084d33cf44413cc2-1] regionserver.HStore(310): Store=120c19ed9dc1ecaf084d33cf44413cc2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,344 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,344 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened 120c19ed9dc1ecaf084d33cf44413cc2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75205975, jitterRate=0.12065635621547699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,344 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for 120c19ed9dc1ecaf084d33cf44413cc2: Writing region info on filesystem at 1676127813328Initializing all the Stores at 1676127813329 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813329Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813329Region opened successfully at 1676127813344 (+15 ms) 2023-02-11 15:03:33,367 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing 120c19ed9dc1ecaf084d33cf44413cc2, disabling compactions & flushes 2023-02-11 15:03:33,367 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,367 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,368 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. after waiting 0 ms 2023-02-11 15:03:33,368 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,376 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,376 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for 120c19ed9dc1ecaf084d33cf44413cc2: Waiting for close lock at 1676127813367Disabling compacts and flushes for region at 1676127813367Disabling writes for close at 1676127813368 (+1 ms)Writing region close event to WAL at 1676127813376 (+8 ms)Closed at 1676127813376 2023-02-11 15:03:33,377 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,377 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,380 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,382 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:33,383 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1 2023-02-11 15:03:33,383 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00eb2ea629b1a4fa9f0272d183912403 columnFamilyName f1 2023-02-11 15:03:33,388 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/testWithMockedMapReduceMultiRegion=00eb2ea629b1a4fa9f0272d183912403-d252c91fe4c74c8a890b2f8fd60cb60b 2023-02-11 15:03:33,389 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(310): Store=00eb2ea629b1a4fa9f0272d183912403/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,389 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:33,390 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2 2023-02-11 15:03:33,390 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 00eb2ea629b1a4fa9f0272d183912403 columnFamilyName f2 2023-02-11 15:03:33,394 DEBUG [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/testWithMockedMapReduceMultiRegion=00eb2ea629b1a4fa9f0272d183912403-938e56d76f644fce9fab8e0ddc18c423 2023-02-11 15:03:33,394 INFO [StoreOpener-00eb2ea629b1a4fa9f0272d183912403-1] regionserver.HStore(310): Store=00eb2ea629b1a4fa9f0272d183912403/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,394 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,394 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened 00eb2ea629b1a4fa9f0272d183912403; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69930242, jitterRate=0.04204180836677551}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,394 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for 00eb2ea629b1a4fa9f0272d183912403: Writing region info on filesystem at 1676127813380Initializing all the Stores at 1676127813381 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813381Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813381Region opened successfully at 1676127813394 (+13 ms) 2023-02-11 15:03:33,403 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing 00eb2ea629b1a4fa9f0272d183912403, disabling compactions & flushes 2023-02-11 15:03:33,403 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,403 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,403 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. after waiting 0 ms 2023-02-11 15:03:33,403 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,404 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,404 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for 00eb2ea629b1a4fa9f0272d183912403: Waiting for close lock at 1676127813403Disabling compacts and flushes for region at 1676127813403Disabling writes for close at 1676127813403Writing region close event to WAL at 1676127813404 (+1 ms)Closed at 1676127813404 2023-02-11 15:03:33,405 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,405 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,406 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,408 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:33,409 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1 2023-02-11 15:03:33,409 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9120d77fe203600a950807cc8b3fdbf6 columnFamilyName f1 2023-02-11 15:03:33,413 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/testWithMockedMapReduceMultiRegion=9120d77fe203600a950807cc8b3fdbf6-635174018f8345979ef4b7d8b2653021 2023-02-11 15:03:33,413 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(310): Store=9120d77fe203600a950807cc8b3fdbf6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,413 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:33,414 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2 2023-02-11 15:03:33,414 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9120d77fe203600a950807cc8b3fdbf6 columnFamilyName f2 2023-02-11 15:03:33,417 DEBUG [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/testWithMockedMapReduceMultiRegion=9120d77fe203600a950807cc8b3fdbf6-29b3499a856645c0924cf3fa90dfbdef 2023-02-11 15:03:33,418 INFO [StoreOpener-9120d77fe203600a950807cc8b3fdbf6-1] regionserver.HStore(310): Store=9120d77fe203600a950807cc8b3fdbf6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,418 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,418 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened 9120d77fe203600a950807cc8b3fdbf6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68979464, jitterRate=0.027874112129211426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,418 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for 9120d77fe203600a950807cc8b3fdbf6: Writing region info on filesystem at 1676127813406Initializing all the Stores at 1676127813407 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813407Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813407Region opened successfully at 1676127813418 (+11 ms) 2023-02-11 15:03:33,426 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing 9120d77fe203600a950807cc8b3fdbf6, disabling compactions & flushes 2023-02-11 15:03:33,427 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,427 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,427 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. after waiting 0 ms 2023-02-11 15:03:33,427 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,427 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,427 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for 9120d77fe203600a950807cc8b3fdbf6: Waiting for close lock at 1676127813426Disabling compacts and flushes for region at 1676127813426Disabling writes for close at 1676127813427 (+1 ms)Writing region close event to WAL at 1676127813427Closed at 1676127813427 2023-02-11 15:03:33,428 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,428 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,429 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,433 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:33,434 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1 2023-02-11 15:03:33,434 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1731510a9f940bccd1171fd1b3f391a4 columnFamilyName f1 2023-02-11 15:03:33,438 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/testWithMockedMapReduceMultiRegion=1731510a9f940bccd1171fd1b3f391a4-a20337bb3cf447efbdf14ff967538581 2023-02-11 15:03:33,438 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(310): Store=1731510a9f940bccd1171fd1b3f391a4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,438 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:33,439 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2 2023-02-11 15:03:33,439 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1731510a9f940bccd1171fd1b3f391a4 columnFamilyName f2 2023-02-11 15:03:33,445 DEBUG [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/testWithMockedMapReduceMultiRegion=1731510a9f940bccd1171fd1b3f391a4-c4ec757af94b413991391155d8847064 2023-02-11 15:03:33,445 INFO [StoreOpener-1731510a9f940bccd1171fd1b3f391a4-1] regionserver.HStore(310): Store=1731510a9f940bccd1171fd1b3f391a4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,445 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,445 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened 1731510a9f940bccd1171fd1b3f391a4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58739011, jitterRate=-0.12472052872180939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,445 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for 1731510a9f940bccd1171fd1b3f391a4: Writing region info on filesystem at 1676127813430Initializing all the Stores at 1676127813430Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813430Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813432 (+2 ms)Region opened successfully at 1676127813445 (+13 ms) 2023-02-11 15:03:33,456 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing 1731510a9f940bccd1171fd1b3f391a4, disabling compactions & flushes 2023-02-11 15:03:33,456 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,456 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,456 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. after waiting 0 ms 2023-02-11 15:03:33,456 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,457 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,457 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for 1731510a9f940bccd1171fd1b3f391a4: Waiting for close lock at 1676127813456Disabling compacts and flushes for region at 1676127813456Disabling writes for close at 1676127813456Writing region close event to WAL at 1676127813457 (+1 ms)Closed at 1676127813457 2023-02-11 15:03:33,457 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,457 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,459 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,460 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:33,461 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1 2023-02-11 15:03:33,461 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b64a4091d79c43fcb24ccf56ddbc7eea columnFamilyName f1 2023-02-11 15:03:33,465 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/testWithMockedMapReduceMultiRegion=b64a4091d79c43fcb24ccf56ddbc7eea-9a39ee9eaf4c483a9f5806c0be9d6936 2023-02-11 15:03:33,465 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(310): Store=b64a4091d79c43fcb24ccf56ddbc7eea/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,465 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:33,466 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2 2023-02-11 15:03:33,466 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b64a4091d79c43fcb24ccf56ddbc7eea columnFamilyName f2 2023-02-11 15:03:33,469 DEBUG [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/testWithMockedMapReduceMultiRegion=b64a4091d79c43fcb24ccf56ddbc7eea-8dbbd7a3e9e343178e770f0363c09ccf 2023-02-11 15:03:33,470 INFO [StoreOpener-b64a4091d79c43fcb24ccf56ddbc7eea-1] regionserver.HStore(310): Store=b64a4091d79c43fcb24ccf56ddbc7eea/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,470 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,470 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened b64a4091d79c43fcb24ccf56ddbc7eea; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67619088, jitterRate=0.0076029300689697266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,470 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for b64a4091d79c43fcb24ccf56ddbc7eea: Writing region info on filesystem at 1676127813459Initializing all the Stores at 1676127813459Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813459Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813459Region opened successfully at 1676127813470 (+11 ms) 2023-02-11 15:03:33,478 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing b64a4091d79c43fcb24ccf56ddbc7eea, disabling compactions & flushes 2023-02-11 15:03:33,478 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,478 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,478 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. after waiting 0 ms 2023-02-11 15:03:33,479 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,479 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,479 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for b64a4091d79c43fcb24ccf56ddbc7eea: Waiting for close lock at 1676127813478Disabling compacts and flushes for region at 1676127813478Disabling writes for close at 1676127813479 (+1 ms)Writing region close event to WAL at 1676127813479Closed at 1676127813479 2023-02-11 15:03:33,480 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,480 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,481 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,483 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:33,484 DEBUG [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f1 2023-02-11 15:03:33,485 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da626f51f61ec776252bd8a862a71fc4 columnFamilyName f1 2023-02-11 15:03:33,485 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(310): Store=da626f51f61ec776252bd8a862a71fc4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,485 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:33,486 DEBUG [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f2 2023-02-11 15:03:33,487 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da626f51f61ec776252bd8a862a71fc4 columnFamilyName f2 2023-02-11 15:03:33,487 INFO [StoreOpener-da626f51f61ec776252bd8a862a71fc4-1] regionserver.HStore(310): Store=da626f51f61ec776252bd8a862a71fc4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,487 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,487 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened da626f51f61ec776252bd8a862a71fc4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71077051, jitterRate=0.05913059413433075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,487 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for da626f51f61ec776252bd8a862a71fc4: Writing region info on filesystem at 1676127813481Initializing all the Stores at 1676127813482 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813482Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813482Region opened successfully at 1676127813487 (+5 ms) 2023-02-11 15:03:33,487 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing da626f51f61ec776252bd8a862a71fc4, disabling compactions & flushes 2023-02-11 15:03:33,488 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,488 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,488 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. after waiting 0 ms 2023-02-11 15:03:33,488 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,488 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,488 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for da626f51f61ec776252bd8a862a71fc4: Waiting for close lock at 1676127813487Disabling compacts and flushes for region at 1676127813487Disabling writes for close at 1676127813488 (+1 ms)Writing region close event to WAL at 1676127813488Closed at 1676127813488 2023-02-11 15:03:33,488 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,489 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,490 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,497 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:33,498 DEBUG [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f1 2023-02-11 15:03:33,498 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e94d50038e610e777074a3609c8bdf3c columnFamilyName f1 2023-02-11 15:03:33,498 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(310): Store=e94d50038e610e777074a3609c8bdf3c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,498 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:33,499 DEBUG [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f2 2023-02-11 15:03:33,499 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e94d50038e610e777074a3609c8bdf3c columnFamilyName f2 2023-02-11 15:03:33,500 INFO [StoreOpener-e94d50038e610e777074a3609c8bdf3c-1] regionserver.HStore(310): Store=e94d50038e610e777074a3609c8bdf3c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,500 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,500 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened e94d50038e610e777074a3609c8bdf3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64864733, jitterRate=-0.033440157771110535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,500 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for e94d50038e610e777074a3609c8bdf3c: Writing region info on filesystem at 1676127813490Initializing all the Stores at 1676127813490Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813490Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813496 (+6 ms)Region opened successfully at 1676127813500 (+4 ms) 2023-02-11 15:03:33,500 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing e94d50038e610e777074a3609c8bdf3c, disabling compactions & flushes 2023-02-11 15:03:33,501 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,501 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,501 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. after waiting 0 ms 2023-02-11 15:03:33,501 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,501 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,501 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for e94d50038e610e777074a3609c8bdf3c: Waiting for close lock at 1676127813500Disabling compacts and flushes for region at 1676127813500Disabling writes for close at 1676127813501 (+1 ms)Writing region close event to WAL at 1676127813501Closed at 1676127813501 2023-02-11 15:03:33,502 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,502 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,503 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,505 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:33,505 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1 2023-02-11 15:03:33,506 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6040f64131175d3b75e155d7c1b46f9 columnFamilyName f1 2023-02-11 15:03:33,510 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/testWithMockedMapReduceMultiRegion=f6040f64131175d3b75e155d7c1b46f9-650ff66037b6465790d12e821e117671 2023-02-11 15:03:33,510 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(310): Store=f6040f64131175d3b75e155d7c1b46f9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,510 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:33,511 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2 2023-02-11 15:03:33,511 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6040f64131175d3b75e155d7c1b46f9 columnFamilyName f2 2023-02-11 15:03:33,515 DEBUG [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/testWithMockedMapReduceMultiRegion=f6040f64131175d3b75e155d7c1b46f9-856f41ef5ddc4e648287a21b0a4e2ab0 2023-02-11 15:03:33,515 INFO [StoreOpener-f6040f64131175d3b75e155d7c1b46f9-1] regionserver.HStore(310): Store=f6040f64131175d3b75e155d7c1b46f9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,515 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,515 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened f6040f64131175d3b75e155d7c1b46f9; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62932483, jitterRate=-0.06223292648792267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,515 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for f6040f64131175d3b75e155d7c1b46f9: Writing region info on filesystem at 1676127813503Initializing all the Stores at 1676127813504 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813504Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813504Region opened successfully at 1676127813515 (+11 ms) 2023-02-11 15:03:33,518 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:33,525 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing f6040f64131175d3b75e155d7c1b46f9, disabling compactions & flushes 2023-02-11 15:03:33,526 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,526 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,526 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. after waiting 0 ms 2023-02-11 15:03:33,526 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,528 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,528 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for f6040f64131175d3b75e155d7c1b46f9: Waiting for close lock at 1676127813525Disabling compacts and flushes for region at 1676127813525Disabling writes for close at 1676127813526 (+1 ms)Writing region close event to WAL at 1676127813528 (+2 ms)Closed at 1676127813528 2023-02-11 15:03:33,529 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,529 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,531 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,533 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:33,533 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1 2023-02-11 15:03:33,534 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cff6457cee34823c2ffa0c66615b5b0f columnFamilyName f1 2023-02-11 15:03:33,545 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/testWithMockedMapReduceMultiRegion=cff6457cee34823c2ffa0c66615b5b0f-45e34eca51894d8d8b6192ffdc14108d 2023-02-11 15:03:33,545 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(310): Store=cff6457cee34823c2ffa0c66615b5b0f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,546 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:33,546 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2 2023-02-11 15:03:33,547 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cff6457cee34823c2ffa0c66615b5b0f columnFamilyName f2 2023-02-11 15:03:33,550 DEBUG [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/testWithMockedMapReduceMultiRegion=cff6457cee34823c2ffa0c66615b5b0f-87bc7d5f47874f049fcaa6cfda66aff5 2023-02-11 15:03:33,550 INFO [StoreOpener-cff6457cee34823c2ffa0c66615b5b0f-1] regionserver.HStore(310): Store=cff6457cee34823c2ffa0c66615b5b0f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,551 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,551 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened cff6457cee34823c2ffa0c66615b5b0f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64238879, jitterRate=-0.042766109108924866}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,551 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for cff6457cee34823c2ffa0c66615b5b0f: Writing region info on filesystem at 1676127813531Initializing all the Stores at 1676127813532 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813532Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813532Region opened successfully at 1676127813551 (+19 ms) 2023-02-11 15:03:33,561 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing cff6457cee34823c2ffa0c66615b5b0f, disabling compactions & flushes 2023-02-11 15:03:33,561 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,561 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,561 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. after waiting 0 ms 2023-02-11 15:03:33,561 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,562 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,562 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for cff6457cee34823c2ffa0c66615b5b0f: Waiting for close lock at 1676127813561Disabling compacts and flushes for region at 1676127813561Disabling writes for close at 1676127813561Writing region close event to WAL at 1676127813562 (+1 ms)Closed at 1676127813562 2023-02-11 15:03:33,563 DEBUG [Listener at localhost/35071] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:33,563 INFO [Listener at localhost/35071] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:33,565 DEBUG [Listener at localhost/35071] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:33,568 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 91530d8340403e062bb1972454785b99 2023-02-11 15:03:33,569 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1 2023-02-11 15:03:33,569 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91530d8340403e062bb1972454785b99 columnFamilyName f1 2023-02-11 15:03:33,574 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/testWithMockedMapReduceMultiRegion=91530d8340403e062bb1972454785b99-d71fc6c6343243e2b1aab2b599ebccc9 2023-02-11 15:03:33,574 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(310): Store=91530d8340403e062bb1972454785b99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,574 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 91530d8340403e062bb1972454785b99 2023-02-11 15:03:33,575 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2 2023-02-11 15:03:33,575 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91530d8340403e062bb1972454785b99 columnFamilyName f2 2023-02-11 15:03:33,579 DEBUG [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(539): loaded hdfs://localhost:34633/user/jenkins/test-data/fb02d285-9564-023f-a620-af98a5684dfc/testWithMockedMapReduceMultiRegion/fe14e840-eda2-4b70-8155-08b6cd2a49e6/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/testWithMockedMapReduceMultiRegion=91530d8340403e062bb1972454785b99-46c84f8dfc4f43379b0566176eaed66e 2023-02-11 15:03:33,580 INFO [StoreOpener-91530d8340403e062bb1972454785b99-1] regionserver.HStore(310): Store=91530d8340403e062bb1972454785b99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:33,580 DEBUG [Listener at localhost/35071] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:33,580 INFO [Listener at localhost/35071] regionserver.HRegion(1071): Opened 91530d8340403e062bb1972454785b99; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60654132, jitterRate=-0.09618300199508667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:33,580 DEBUG [Listener at localhost/35071] regionserver.HRegion(964): Region open journal for 91530d8340403e062bb1972454785b99: Writing region info on filesystem at 1676127813565Initializing all the Stores at 1676127813566 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813566Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127813567 (+1 ms)Region opened successfully at 1676127813580 (+13 ms) 2023-02-11 15:03:33,591 DEBUG [Listener at localhost/35071] regionserver.HRegion(1603): Closing 91530d8340403e062bb1972454785b99, disabling compactions & flushes 2023-02-11 15:03:33,592 INFO [Listener at localhost/35071] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,592 DEBUG [Listener at localhost/35071] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,592 DEBUG [Listener at localhost/35071] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. after waiting 0 ms 2023-02-11 15:03:33,592 DEBUG [Listener at localhost/35071] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,592 INFO [Listener at localhost/35071] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,593 DEBUG [Listener at localhost/35071] regionserver.HRegion(1557): Region close journal for 91530d8340403e062bb1972454785b99: Waiting for close lock at 1676127813591Disabling compacts and flushes for region at 1676127813591Disabling writes for close at 1676127813592 (+1 ms)Writing region close event to WAL at 1676127813592Closed at 1676127813592 2023-02-11 15:03:33,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-11 15:03:33,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,603 INFO [Listener at localhost/35071] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:33,608 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127813608"}]},"ts":"1676127813608"} 2023-02-11 15:03:33,611 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-11 15:03:33,612 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-11 15:03:33,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, UNASSIGN}] 2023-02-11 15:03:33,615 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, UNASSIGN 2023-02-11 15:03:33,615 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, UNASSIGN 2023-02-11 15:03:33,615 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, UNASSIGN 2023-02-11 15:03:33,615 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, UNASSIGN 2023-02-11 15:03:33,616 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, UNASSIGN 2023-02-11 15:03:33,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=cff6457cee34823c2ffa0c66615b5b0f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:33,616 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813616"}]},"ts":"1676127813616"} 2023-02-11 15:03:33,616 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=120c19ed9dc1ecaf084d33cf44413cc2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:33,616 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=da626f51f61ec776252bd8a862a71fc4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:33,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=00eb2ea629b1a4fa9f0272d183912403, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:33,617 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127813616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813616"}]},"ts":"1676127813616"} 2023-02-11 15:03:33,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813616"}]},"ts":"1676127813616"} 2023-02-11 15:03:33,617 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e94d50038e610e777074a3609c8bdf3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:33,617 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127813617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813617"}]},"ts":"1676127813617"} 2023-02-11 15:03:33,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813616"}]},"ts":"1676127813616"} 2023-02-11 15:03:33,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure cff6457cee34823c2ffa0c66615b5b0f, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:33,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=34, state=RUNNABLE; CloseRegionProcedure da626f51f61ec776252bd8a862a71fc4, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:33,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 120c19ed9dc1ecaf084d33cf44413cc2, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:33,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure e94d50038e610e777074a3609c8bdf3c, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:33,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=36, state=RUNNABLE; CloseRegionProcedure 00eb2ea629b1a4fa9f0272d183912403, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:33,622 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, UNASSIGN 2023-02-11 15:03:33,622 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, UNASSIGN 2023-02-11 15:03:33,623 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=1731510a9f940bccd1171fd1b3f391a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:33,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=91530d8340403e062bb1972454785b99, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:33,623 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, UNASSIGN 2023-02-11 15:03:33,623 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813623"}]},"ts":"1676127813623"} 2023-02-11 15:03:33,623 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813623"}]},"ts":"1676127813623"} 2023-02-11 15:03:33,623 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, UNASSIGN 2023-02-11 15:03:33,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=41, state=RUNNABLE; CloseRegionProcedure 91530d8340403e062bb1972454785b99, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:33,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=42, state=RUNNABLE; CloseRegionProcedure 1731510a9f940bccd1171fd1b3f391a4, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:33,626 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9120d77fe203600a950807cc8b3fdbf6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:33,626 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f6040f64131175d3b75e155d7c1b46f9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:33,626 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813626"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813626"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813626"}]},"ts":"1676127813626"} 2023-02-11 15:03:33,626 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, UNASSIGN 2023-02-11 15:03:33,626 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813626"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813626"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813626"}]},"ts":"1676127813626"} 2023-02-11 15:03:33,627 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b64a4091d79c43fcb24ccf56ddbc7eea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:33,627 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127813627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127813627"}]},"ts":"1676127813627"} 2023-02-11 15:03:33,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 9120d77fe203600a950807cc8b3fdbf6, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:33,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure f6040f64131175d3b75e155d7c1b46f9, server=jenkins-hbase4.apache.org,43987,1676127807437}] 2023-02-11 15:03:33,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure b64a4091d79c43fcb24ccf56ddbc7eea, server=jenkins-hbase4.apache.org,43213,1676127807466}] 2023-02-11 15:03:33,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:33,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:33,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:33,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da626f51f61ec776252bd8a862a71fc4, disabling compactions & flushes 2023-02-11 15:03:33,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1731510a9f940bccd1171fd1b3f391a4, disabling compactions & flushes 2023-02-11 15:03:33,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. after waiting 0 ms 2023-02-11 15:03:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. after waiting 0 ms 2023-02-11 15:03:33,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 15:03:33,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4. 2023-02-11 15:03:33,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4. 2023-02-11 15:03:33,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da626f51f61ec776252bd8a862a71fc4: Waiting for close lock at 1676127813771Running coprocessor pre-close hooks at 1676127813771Disabling compacts and flushes for region at 1676127813771Disabling writes for close at 1676127813772 (+1 ms)Writing region close event to WAL at 1676127813772Running coprocessor post-close hooks at 1676127813775 (+3 ms)Closed at 1676127813777 (+2 ms) 2023-02-11 15:03:33,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1731510a9f940bccd1171fd1b3f391a4: Waiting for close lock at 1676127813771Running coprocessor pre-close hooks at 1676127813771Disabling compacts and flushes for region at 1676127813771Disabling writes for close at 1676127813772 (+1 ms)Writing region close event to WAL at 1676127813773 (+1 ms)Running coprocessor post-close hooks at 1676127813776 (+3 ms)Closed at 1676127813777 (+1 ms) 2023-02-11 15:03:33,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:33,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:33,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 00eb2ea629b1a4fa9f0272d183912403, disabling compactions & flushes 2023-02-11 15:03:33,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. after waiting 0 ms 2023-02-11 15:03:33,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,779 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=1731510a9f940bccd1171fd1b3f391a4, regionState=CLOSED 2023-02-11 15:03:33,779 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813779"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813779"}]},"ts":"1676127813779"} 2023-02-11 15:03:33,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:33,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:33,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e94d50038e610e777074a3609c8bdf3c, disabling compactions & flushes 2023-02-11 15:03:33,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. after waiting 0 ms 2023-02-11 15:03:33,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,780 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=da626f51f61ec776252bd8a862a71fc4, regionState=CLOSED 2023-02-11 15:03:33,780 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127813780"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813780"}]},"ts":"1676127813780"} 2023-02-11 15:03:33,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=42 2023-02-11 15:03:33,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=42, state=SUCCESS; CloseRegionProcedure 1731510a9f940bccd1171fd1b3f391a4, server=jenkins-hbase4.apache.org,43213,1676127807466 in 156 msec 2023-02-11 15:03:33,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=34 2023-02-11 15:03:33,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=34, state=SUCCESS; CloseRegionProcedure da626f51f61ec776252bd8a862a71fc4, server=jenkins-hbase4.apache.org,43987,1676127807437 in 162 msec 2023-02-11 15:03:33,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-11 15:03:33,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c. 2023-02-11 15:03:33,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e94d50038e610e777074a3609c8bdf3c: Waiting for close lock at 1676127813780Running coprocessor pre-close hooks at 1676127813780Disabling compacts and flushes for region at 1676127813780Disabling writes for close at 1676127813780Writing region close event to WAL at 1676127813780Running coprocessor post-close hooks at 1676127813784 (+4 ms)Closed at 1676127813785 (+1 ms) 2023-02-11 15:03:33,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1731510a9f940bccd1171fd1b3f391a4, UNASSIGN in 170 msec 2023-02-11 15:03:33,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=da626f51f61ec776252bd8a862a71fc4, UNASSIGN in 170 msec 2023-02-11 15:03:33,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:33,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:33,788 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e94d50038e610e777074a3609c8bdf3c, regionState=CLOSED 2023-02-11 15:03:33,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f6040f64131175d3b75e155d7c1b46f9, disabling compactions & flushes 2023-02-11 15:03:33,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. after waiting 0 ms 2023-02-11 15:03:33,789 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676127813788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813788"}]},"ts":"1676127813788"} 2023-02-11 15:03:33,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403. 2023-02-11 15:03:33,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 00eb2ea629b1a4fa9f0272d183912403: Waiting for close lock at 1676127813779Running coprocessor pre-close hooks at 1676127813779Disabling compacts and flushes for region at 1676127813779Disabling writes for close at 1676127813779Writing region close event to WAL at 1676127813780 (+1 ms)Running coprocessor post-close hooks at 1676127813790 (+10 ms)Closed at 1676127813791 (+1 ms) 2023-02-11 15:03:33,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-11 15:03:33,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:33,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure e94d50038e610e777074a3609c8bdf3c, server=jenkins-hbase4.apache.org,43987,1676127807437 in 169 msec 2023-02-11 15:03:33,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:33,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b64a4091d79c43fcb24ccf56ddbc7eea, disabling compactions & flushes 2023-02-11 15:03:33,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=00eb2ea629b1a4fa9f0272d183912403, regionState=CLOSED 2023-02-11 15:03:33,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. after waiting 0 ms 2023-02-11 15:03:33,793 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813793"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813793"}]},"ts":"1676127813793"} 2023-02-11 15:03:33,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e94d50038e610e777074a3609c8bdf3c, UNASSIGN in 180 msec 2023-02-11 15:03:33,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=36 2023-02-11 15:03:33,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=36, state=SUCCESS; CloseRegionProcedure 00eb2ea629b1a4fa9f0272d183912403, server=jenkins-hbase4.apache.org,43213,1676127807466 in 173 msec 2023-02-11 15:03:33,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=00eb2ea629b1a4fa9f0272d183912403, UNASSIGN in 182 msec 2023-02-11 15:03:33,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9. 2023-02-11 15:03:33,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f6040f64131175d3b75e155d7c1b46f9: Waiting for close lock at 1676127813789Running coprocessor pre-close hooks at 1676127813789Disabling compacts and flushes for region at 1676127813789Disabling writes for close at 1676127813789Writing region close event to WAL at 1676127813790 (+1 ms)Running coprocessor post-close hooks at 1676127813796 (+6 ms)Closed at 1676127813797 (+1 ms) 2023-02-11 15:03:33,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:33,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 91530d8340403e062bb1972454785b99 2023-02-11 15:03:33,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 91530d8340403e062bb1972454785b99, disabling compactions & flushes 2023-02-11 15:03:33,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. after waiting 0 ms 2023-02-11 15:03:33,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,798 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=f6040f64131175d3b75e155d7c1b46f9, regionState=CLOSED 2023-02-11 15:03:33,799 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813798"}]},"ts":"1676127813798"} 2023-02-11 15:03:33,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea. 2023-02-11 15:03:33,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b64a4091d79c43fcb24ccf56ddbc7eea: Waiting for close lock at 1676127813793Running coprocessor pre-close hooks at 1676127813793Disabling compacts and flushes for region at 1676127813793Disabling writes for close at 1676127813793Writing region close event to WAL at 1676127813797 (+4 ms)Running coprocessor post-close hooks at 1676127813801 (+4 ms)Closed at 1676127813802 (+1 ms) 2023-02-11 15:03:33,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-11 15:03:33,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure f6040f64131175d3b75e155d7c1b46f9, server=jenkins-hbase4.apache.org,43987,1676127807437 in 172 msec 2023-02-11 15:03:33,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:33,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9120d77fe203600a950807cc8b3fdbf6, disabling compactions & flushes 2023-02-11 15:03:33,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. after waiting 0 ms 2023-02-11 15:03:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,803 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b64a4091d79c43fcb24ccf56ddbc7eea, regionState=CLOSED 2023-02-11 15:03:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=f6040f64131175d3b75e155d7c1b46f9, UNASSIGN in 189 msec 2023-02-11 15:03:33,804 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813803"}]},"ts":"1676127813803"} 2023-02-11 15:03:33,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-11 15:03:33,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure b64a4091d79c43fcb24ccf56ddbc7eea, server=jenkins-hbase4.apache.org,43213,1676127807466 in 173 msec 2023-02-11 15:03:33,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=b64a4091d79c43fcb24ccf56ddbc7eea, UNASSIGN in 193 msec 2023-02-11 15:03:33,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99. 2023-02-11 15:03:33,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 91530d8340403e062bb1972454785b99: Waiting for close lock at 1676127813798Running coprocessor pre-close hooks at 1676127813798Disabling compacts and flushes for region at 1676127813798Disabling writes for close at 1676127813798Writing region close event to WAL at 1676127813800 (+2 ms)Running coprocessor post-close hooks at 1676127813804 (+4 ms)Closed at 1676127813810 (+6 ms) 2023-02-11 15:03:33,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 91530d8340403e062bb1972454785b99 2023-02-11 15:03:33,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:33,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 120c19ed9dc1ecaf084d33cf44413cc2, disabling compactions & flushes 2023-02-11 15:03:33,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. after waiting 0 ms 2023-02-11 15:03:33,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,811 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=91530d8340403e062bb1972454785b99, regionState=CLOSED 2023-02-11 15:03:33,811 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813811"}]},"ts":"1676127813811"} 2023-02-11 15:03:33,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6. 2023-02-11 15:03:33,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9120d77fe203600a950807cc8b3fdbf6: Waiting for close lock at 1676127813803Running coprocessor pre-close hooks at 1676127813803Disabling compacts and flushes for region at 1676127813803Disabling writes for close at 1676127813803Writing region close event to WAL at 1676127813810 (+7 ms)Running coprocessor post-close hooks at 1676127813813 (+3 ms)Closed at 1676127813814 (+1 ms) 2023-02-11 15:03:33,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=41 2023-02-11 15:03:33,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=41, state=SUCCESS; CloseRegionProcedure 91530d8340403e062bb1972454785b99, server=jenkins-hbase4.apache.org,43987,1676127807437 in 189 msec 2023-02-11 15:03:33,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:33,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:33,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cff6457cee34823c2ffa0c66615b5b0f, disabling compactions & flushes 2023-02-11 15:03:33,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. after waiting 0 ms 2023-02-11 15:03:33,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,816 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=9120d77fe203600a950807cc8b3fdbf6, regionState=CLOSED 2023-02-11 15:03:33,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=91530d8340403e062bb1972454785b99, UNASSIGN in 202 msec 2023-02-11 15:03:33,816 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813816"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813816"}]},"ts":"1676127813816"} 2023-02-11 15:03:33,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-11 15:03:33,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 9120d77fe203600a950807cc8b3fdbf6, server=jenkins-hbase4.apache.org,43213,1676127807466 in 190 msec 2023-02-11 15:03:33,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2. 2023-02-11 15:03:33,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 120c19ed9dc1ecaf084d33cf44413cc2: Waiting for close lock at 1676127813811Running coprocessor pre-close hooks at 1676127813811Disabling compacts and flushes for region at 1676127813811Disabling writes for close at 1676127813811Writing region close event to WAL at 1676127813813 (+2 ms)Running coprocessor post-close hooks at 1676127813819 (+6 ms)Closed at 1676127813819 2023-02-11 15:03:33,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9120d77fe203600a950807cc8b3fdbf6, UNASSIGN in 205 msec 2023-02-11 15:03:33,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:33,822 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=120c19ed9dc1ecaf084d33cf44413cc2, regionState=CLOSED 2023-02-11 15:03:33,822 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813822"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813822"}]},"ts":"1676127813822"} 2023-02-11 15:03:33,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:33,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f. 2023-02-11 15:03:33,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cff6457cee34823c2ffa0c66615b5b0f: Waiting for close lock at 1676127813816Running coprocessor pre-close hooks at 1676127813816Disabling compacts and flushes for region at 1676127813816Disabling writes for close at 1676127813816Writing region close event to WAL at 1676127813820 (+4 ms)Running coprocessor post-close hooks at 1676127813823 (+3 ms)Closed at 1676127813824 (+1 ms) 2023-02-11 15:03:33,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-11 15:03:33,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 120c19ed9dc1ecaf084d33cf44413cc2, server=jenkins-hbase4.apache.org,43987,1676127807437 in 204 msec 2023-02-11 15:03:33,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:33,825 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=cff6457cee34823c2ffa0c66615b5b0f, regionState=CLOSED 2023-02-11 15:03:33,825 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676127813825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127813825"}]},"ts":"1676127813825"} 2023-02-11 15:03:33,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=120c19ed9dc1ecaf084d33cf44413cc2, UNASSIGN in 212 msec 2023-02-11 15:03:33,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-11 15:03:33,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure cff6457cee34823c2ffa0c66615b5b0f, server=jenkins-hbase4.apache.org,43213,1676127807466 in 208 msec 2023-02-11 15:03:33,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-11 15:03:33,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cff6457cee34823c2ffa0c66615b5b0f, UNASSIGN in 214 msec 2023-02-11 15:03:33,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127813829"}]},"ts":"1676127813829"} 2023-02-11 15:03:33,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-11 15:03:33,831 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-11 15:03:33,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 227 msec 2023-02-11 15:03:33,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-11 15:03:33,911 INFO [Listener at localhost/35071] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-11 15:03:33,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 15:03:33,916 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,928 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:33,929 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:33,932 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/recovered.edits] 2023-02-11 15:03:33,933 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/recovered.edits] 2023-02-11 15:03:33,933 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/recovered.edits] 2023-02-11 15:03:33,933 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/recovered.edits] 2023-02-11 15:03:33,934 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/recovered.edits] 2023-02-11 15:03:33,934 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/recovered.edits] 2023-02-11 15:03:33,934 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/recovered.edits] 2023-02-11 15:03:33,936 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/recovered.edits] 2023-02-11 15:03:33,940 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/1d68ebddfece473ba598a2e913132cbe to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/1d68ebddfece473ba598a2e913132cbe 2023-02-11 15:03:33,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/9a39ee9eaf4c483a9f5806c0be9d6936 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/9a39ee9eaf4c483a9f5806c0be9d6936 2023-02-11 15:03:33,942 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/45e34eca51894d8d8b6192ffdc14108d to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f1/45e34eca51894d8d8b6192ffdc14108d 2023-02-11 15:03:33,944 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bc7998bb9f574a7a94ae367334a0d2b4 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bc7998bb9f574a7a94ae367334a0d2b4 2023-02-11 15:03:33,946 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/aab61e21b5154a7ca34b461cea7130e0 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f1/aab61e21b5154a7ca34b461cea7130e0 2023-02-11 15:03:33,946 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/635174018f8345979ef4b7d8b2653021 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/635174018f8345979ef4b7d8b2653021 2023-02-11 15:03:33,946 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/4ea1a1e121e042f3be64e56dad73661f to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/4ea1a1e121e042f3be64e56dad73661f 2023-02-11 15:03:33,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bea7bec40eac49a693c3347ea694f14a to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f1/bea7bec40eac49a693c3347ea694f14a 2023-02-11 15:03:33,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/0afa436207bb4ce794fc74466a96d0df to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/0afa436207bb4ce794fc74466a96d0df 2023-02-11 15:03:33,947 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/836c2962789c4c5789ea7c4474e8df7e to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/836c2962789c4c5789ea7c4474e8df7e 2023-02-11 15:03:33,947 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/recovered.edits/6.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4/recovered.edits/6.seqid 2023-02-11 15:03:33,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/da626f51f61ec776252bd8a862a71fc4 2023-02-11 15:03:33,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:33,950 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/650ff66037b6465790d12e821e117671 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f1/650ff66037b6465790d12e821e117671 2023-02-11 15:03:33,950 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/979312762f504fb8bc9bf763cfa30bee to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f1/979312762f504fb8bc9bf763cfa30bee 2023-02-11 15:03:33,952 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/17cac2a5e107410f831361dfd665f61f to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/17cac2a5e107410f831361dfd665f61f 2023-02-11 15:03:33,952 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/d252c91fe4c74c8a890b2f8fd60cb60b to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f1/d252c91fe4c74c8a890b2f8fd60cb60b 2023-02-11 15:03:33,952 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/d71fc6c6343243e2b1aab2b599ebccc9 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f1/d71fc6c6343243e2b1aab2b599ebccc9 2023-02-11 15:03:33,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8dbbd7a3e9e343178e770f0363c09ccf to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8dbbd7a3e9e343178e770f0363c09ccf 2023-02-11 15:03:33,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/recovered.edits] 2023-02-11 15:03:33,954 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/87bc7d5f47874f049fcaa6cfda66aff5 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/f2/87bc7d5f47874f049fcaa6cfda66aff5 2023-02-11 15:03:33,955 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/5ad9d407c8934834a2d3ba5cac3f7f5a to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/5ad9d407c8934834a2d3ba5cac3f7f5a 2023-02-11 15:03:33,956 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8fafa1cd0bba4a48b3cbe63d3032d98b to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/f2/8fafa1cd0bba4a48b3cbe63d3032d98b 2023-02-11 15:03:33,956 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/29b3499a856645c0924cf3fa90dfbdef to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/29b3499a856645c0924cf3fa90dfbdef 2023-02-11 15:03:33,957 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/a1ba518535ca450b8e8efcc11aa0d23e to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/a1ba518535ca450b8e8efcc11aa0d23e 2023-02-11 15:03:33,957 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/46c84f8dfc4f43379b0566176eaed66e to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/46c84f8dfc4f43379b0566176eaed66e 2023-02-11 15:03:33,963 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/938e56d76f644fce9fab8e0ddc18c423 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/938e56d76f644fce9fab8e0ddc18c423 2023-02-11 15:03:33,965 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/856f41ef5ddc4e648287a21b0a4e2ab0 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/f2/856f41ef5ddc4e648287a21b0a4e2ab0 2023-02-11 15:03:33,966 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/d57e5ed36e1f4f6cafa9d8ba4d425010 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/f2/d57e5ed36e1f4f6cafa9d8ba4d425010 2023-02-11 15:03:33,967 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/d9a06a7f52d64920a43fdf47ed817fc1 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/f2/d9a06a7f52d64920a43fdf47ed817fc1 2023-02-11 15:03:33,967 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/b0fa21ae6c904cbeb31757b003c42897 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/f2/b0fa21ae6c904cbeb31757b003c42897 2023-02-11 15:03:33,969 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/a23c47c5d86443898b4ed22e9c7c6b95 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/f2/a23c47c5d86443898b4ed22e9c7c6b95 2023-02-11 15:03:33,970 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea/recovered.edits/12.seqid 2023-02-11 15:03:33,970 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/5ff4b6f92427422da409b95a3b864324 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/5ff4b6f92427422da409b95a3b864324 2023-02-11 15:03:33,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/b64a4091d79c43fcb24ccf56ddbc7eea 2023-02-11 15:03:33,971 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:33,971 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f/recovered.edits/12.seqid 2023-02-11 15:03:33,972 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/cff6457cee34823c2ffa0c66615b5b0f 2023-02-11 15:03:33,974 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f1, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/f2, FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/recovered.edits] 2023-02-11 15:03:33,975 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/a20337bb3cf447efbdf14ff967538581 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f1/a20337bb3cf447efbdf14ff967538581 2023-02-11 15:03:33,975 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6/recovered.edits/12.seqid 2023-02-11 15:03:33,975 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9/recovered.edits/12.seqid 2023-02-11 15:03:33,975 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403/recovered.edits/12.seqid 2023-02-11 15:03:33,976 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/f6040f64131175d3b75e155d7c1b46f9 2023-02-11 15:03:33,976 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/9120d77fe203600a950807cc8b3fdbf6 2023-02-11 15:03:33,976 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/00eb2ea629b1a4fa9f0272d183912403 2023-02-11 15:03:33,977 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99/recovered.edits/12.seqid 2023-02-11 15:03:33,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2/recovered.edits/12.seqid 2023-02-11 15:03:33,979 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/91530d8340403e062bb1972454785b99 2023-02-11 15:03:33,979 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/120c19ed9dc1ecaf084d33cf44413cc2 2023-02-11 15:03:33,980 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/aca84797fd464a2198939472a06c3da3 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/aca84797fd464a2198939472a06c3da3 2023-02-11 15:03:33,982 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/c4ec757af94b413991391155d8847064 to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/f2/c4ec757af94b413991391155d8847064 2023-02-11 15:03:33,984 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/recovered.edits/6.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c/recovered.edits/6.seqid 2023-02-11 15:03:33,985 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/e94d50038e610e777074a3609c8bdf3c 2023-02-11 15:03:33,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/recovered.edits/12.seqid to hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/archive/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4/recovered.edits/12.seqid 2023-02-11 15:03:33,987 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1731510a9f940bccd1171fd1b3f391a4 2023-02-11 15:03:33,987 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-11 15:03:33,989 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,991 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-11 15:03:33,994 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-11 15:03:33,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:33,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-11 15:03:33,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127813995"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:33,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-11 15:03:33,998 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => da626f51f61ec776252bd8a862a71fc4, NAME => 'testWithMockedMapReduceMultiRegion,,1676127808706.da626f51f61ec776252bd8a862a71fc4.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => cff6457cee34823c2ffa0c66615b5b0f, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676127808706.cff6457cee34823c2ffa0c66615b5b0f.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 00eb2ea629b1a4fa9f0272d183912403, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676127808706.00eb2ea629b1a4fa9f0272d183912403.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 120c19ed9dc1ecaf084d33cf44413cc2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676127808706.120c19ed9dc1ecaf084d33cf44413cc2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => b64a4091d79c43fcb24ccf56ddbc7eea, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676127808706.b64a4091d79c43fcb24ccf56ddbc7eea.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => f6040f64131175d3b75e155d7c1b46f9, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676127808706.f6040f64131175d3b75e155d7c1b46f9.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 9120d77fe203600a950807cc8b3fdbf6, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676127808706.9120d77fe203600a950807cc8b3fdbf6.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 91530d8340403e062bb1972454785b99, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676127808706.91530d8340403e062bb1972454785b99.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 1731510a9f940bccd1171fd1b3f391a4, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676127808706.1731510a9f940bccd1171fd1b3f391a4.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => e94d50038e610e777074a3609c8bdf3c, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676127808706.e94d50038e610e777074a3609c8bdf3c.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-11 15:03:33,999 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-11 15:03:33,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676127813999"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:34,001 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-11 15:03:34,003 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-11 15:03:34,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 91 msec 2023-02-11 15:03:34,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-11 15:03:34,021 INFO [Listener at localhost/35071] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-11 15:03:34,021 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:34,021 INFO [Listener at localhost/35071] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:34,021 DEBUG [Listener at localhost/35071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fdcd978 to 127.0.0.1:59327 2023-02-11 15:03:34,022 DEBUG [Listener at localhost/35071] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,022 DEBUG [Listener at localhost/35071] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:34,022 DEBUG [Listener at localhost/35071] util.JVMClusterUtil(257): Found active master hash=118482115, stopped=false 2023-02-11 15:03:34,022 INFO [Listener at localhost/35071] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:34,024 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:34,024 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:34,024 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:34,024 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:34,024 INFO [Listener at localhost/35071] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:34,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:34,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:34,026 DEBUG [Listener at localhost/35071] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5225df96 to 127.0.0.1:59327 2023-02-11 15:03:34,026 DEBUG [Listener at localhost/35071] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,026 INFO [Listener at localhost/35071] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43987,1676127807437' ***** 2023-02-11 15:03:34,027 INFO [Listener at localhost/35071] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:34,027 INFO [Listener at localhost/35071] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43213,1676127807466' ***** 2023-02-11 15:03:34,027 INFO [Listener at localhost/35071] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:34,027 INFO [RS:1;jenkins-hbase4:43213] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:34,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:34,027 INFO [RS:1;jenkins-hbase4:43213] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:34,027 INFO [RS:0;jenkins-hbase4:43987] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:34,028 DEBUG [RS:0;jenkins-hbase4:43987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f1afacf to 127.0.0.1:59327 2023-02-11 15:03:34,028 DEBUG [RS:0;jenkins-hbase4:43987] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:34,028 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:34,028 INFO [RS:1;jenkins-hbase4:43213] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:34,027 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:34,029 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(3304): Received CLOSE for 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:34,029 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:34,028 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:34,029 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 15:03:34,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4be4b15c7700072d8db21a1905df814b, disabling compactions & flushes 2023-02-11 15:03:34,031 DEBUG [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:34,029 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:34,031 DEBUG [RS:1;jenkins-hbase4:43213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b82237f to 127.0.0.1:59327 2023-02-11 15:03:34,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:34,031 DEBUG [RS:1;jenkins-hbase4:43213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,031 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:34,031 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:34,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:34,031 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1479): Online Regions={4be4b15c7700072d8db21a1905df814b=hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b.} 2023-02-11 15:03:34,031 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:34,032 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1505): Waiting on 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:34,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. after waiting 0 ms 2023-02-11 15:03:34,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:34,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:34,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:34,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4be4b15c7700072d8db21a1905df814b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:34,032 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:34,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-11 15:03:34,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/.tmp/info/bd3da5f56096433b80d8832b1957b3d4 2023-02-11 15:03:34,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd3da5f56096433b80d8832b1957b3d4 2023-02-11 15:03:34,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/.tmp/rep_barrier/1267d87fd420428ebd01066aca60c368 2023-02-11 15:03:34,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1267d87fd420428ebd01066aca60c368 2023-02-11 15:03:34,067 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:34,069 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:34,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/.tmp/table/2c104d6e4003498d8d3a5a05e389886a 2023-02-11 15:03:34,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c104d6e4003498d8d3a5a05e389886a 2023-02-11 15:03:34,087 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/.tmp/info/bd3da5f56096433b80d8832b1957b3d4 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/info/bd3da5f56096433b80d8832b1957b3d4 2023-02-11 15:03:34,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd3da5f56096433b80d8832b1957b3d4 2023-02-11 15:03:34,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/info/bd3da5f56096433b80d8832b1957b3d4, entries=30, sequenceid=57, filesize=8.3 K 2023-02-11 15:03:34,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/.tmp/rep_barrier/1267d87fd420428ebd01066aca60c368 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/rep_barrier/1267d87fd420428ebd01066aca60c368 2023-02-11 15:03:34,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1267d87fd420428ebd01066aca60c368 2023-02-11 15:03:34,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/rep_barrier/1267d87fd420428ebd01066aca60c368, entries=10, sequenceid=57, filesize=6.1 K 2023-02-11 15:03:34,097 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/.tmp/table/2c104d6e4003498d8d3a5a05e389886a as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/table/2c104d6e4003498d8d3a5a05e389886a 2023-02-11 15:03:34,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c104d6e4003498d8d3a5a05e389886a 2023-02-11 15:03:34,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/table/2c104d6e4003498d8d3a5a05e389886a, entries=13, sequenceid=57, filesize=6.1 K 2023-02-11 15:03:34,101 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=57, compaction requested=false 2023-02-11 15:03:34,106 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-11 15:03:34,107 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:34,108 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:34,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127814029Running coprocessor pre-close hooks at 1676127814029Disabling compacts and flushes for region at 1676127814029Disabling writes for close at 1676127814032 (+3 ms)Obtaining lock to block concurrent updates at 1676127814032Preparing flush snapshotting stores in 1588230740 at 1676127814032Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676127814032Flushing stores of hbase:meta,,1.1588230740 at 1676127814033 (+1 ms)Flushing 1588230740/info: creating writer at 1676127814033Flushing 1588230740/info: appending metadata at 1676127814035 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676127814036 (+1 ms)Flushing 1588230740/rep_barrier: creating writer at 1676127814057 (+21 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676127814059 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676127814059Flushing 1588230740/table: creating writer at 1676127814068 (+9 ms)Flushing 1588230740/table: appending metadata at 1676127814072 (+4 ms)Flushing 1588230740/table: closing flushed file at 1676127814072Flushing 1588230740/info: reopening flushed file at 1676127814087 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676127814093 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676127814097 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 69ms, sequenceid=57, compaction requested=false at 1676127814101 (+4 ms)Writing region close event to WAL at 1676127814104 (+3 ms)Running coprocessor post-close hooks at 1676127814107 (+3 ms)Closed at 1676127814108 (+1 ms) 2023-02-11 15:03:34,108 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:34,231 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43987,1676127807437; all regions closed. 2023-02-11 15:03:34,232 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1505): Waiting on 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:34,235 DEBUG [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/oldWALs 2023-02-11 15:03:34,235 INFO [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43987%2C1676127807437.meta:.meta(num 1676127807997) 2023-02-11 15:03:34,238 DEBUG [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/oldWALs 2023-02-11 15:03:34,238 INFO [RS:0;jenkins-hbase4:43987] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43987%2C1676127807437:(num 1676127808784) 2023-02-11 15:03:34,238 DEBUG [RS:0;jenkins-hbase4:43987] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,238 INFO [RS:0;jenkins-hbase4:43987] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:34,239 INFO [RS:0;jenkins-hbase4:43987] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:34,239 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:34,240 INFO [RS:0;jenkins-hbase4:43987] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43987 2023-02-11 15:03:34,241 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:34,241 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:34,241 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43987,1676127807437 2023-02-11 15:03:34,241 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:34,242 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2288182c rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,242 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:34,242 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30b794ef rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,243 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43987,1676127807437] 2023-02-11 15:03:34,243 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43987,1676127807437; numProcessing=1 2023-02-11 15:03:34,244 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43987,1676127807437 already deleted, retry=false 2023-02-11 15:03:34,244 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43987,1676127807437 expired; onlineServers=1 2023-02-11 15:03:34,426 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:34,426 INFO [RS:0;jenkins-hbase4:43987] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43987,1676127807437; zookeeper connection closed. 2023-02-11 15:03:34,426 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48746beb rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,426 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1dec7ef5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1dec7ef5 2023-02-11 15:03:34,426 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43987-0x10043e891360001, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:34,426 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f860128 rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,432 DEBUG [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1505): Waiting on 4be4b15c7700072d8db21a1905df814b 2023-02-11 15:03:34,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/.tmp/info/1da809d2234846448422558015fa27eb 2023-02-11 15:03:34,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/.tmp/info/1da809d2234846448422558015fa27eb as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/info/1da809d2234846448422558015fa27eb 2023-02-11 15:03:34,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/info/1da809d2234846448422558015fa27eb, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:34,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4be4b15c7700072d8db21a1905df814b in 433ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:34,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/data/hbase/namespace/4be4b15c7700072d8db21a1905df814b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:34,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:34,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4be4b15c7700072d8db21a1905df814b: Waiting for close lock at 1676127814029Running coprocessor pre-close hooks at 1676127814029Disabling compacts and flushes for region at 1676127814029Disabling writes for close at 1676127814032 (+3 ms)Obtaining lock to block concurrent updates at 1676127814032Preparing flush snapshotting stores in 4be4b15c7700072d8db21a1905df814b at 1676127814032Finished memstore snapshotting hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127814032Flushing stores of hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. at 1676127814033 (+1 ms)Flushing 4be4b15c7700072d8db21a1905df814b/info: creating writer at 1676127814033Flushing 4be4b15c7700072d8db21a1905df814b/info: appending metadata at 1676127814041 (+8 ms)Flushing 4be4b15c7700072d8db21a1905df814b/info: closing flushed file at 1676127814041Flushing 4be4b15c7700072d8db21a1905df814b/info: reopening flushed file at 1676127814461 (+420 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4be4b15c7700072d8db21a1905df814b in 433ms, sequenceid=6, compaction requested=false at 1676127814465 (+4 ms)Writing region close event to WAL at 1676127814465Running coprocessor post-close hooks at 1676127814468 (+3 ms)Closed at 1676127814469 (+1 ms) 2023-02-11 15:03:34,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127808053.4be4b15c7700072d8db21a1905df814b. 2023-02-11 15:03:34,632 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43213,1676127807466; all regions closed. 2023-02-11 15:03:34,636 DEBUG [RS:1;jenkins-hbase4:43213] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/oldWALs 2023-02-11 15:03:34,636 INFO [RS:1;jenkins-hbase4:43213] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43213%2C1676127807466:(num 1676127808419) 2023-02-11 15:03:34,636 DEBUG [RS:1;jenkins-hbase4:43213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,636 INFO [RS:1;jenkins-hbase4:43213] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:34,636 INFO [RS:1;jenkins-hbase4:43213] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:34,637 INFO [RS:1;jenkins-hbase4:43213] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:34,637 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:34,637 INFO [RS:1;jenkins-hbase4:43213] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:34,637 INFO [RS:1;jenkins-hbase4:43213] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:34,638 INFO [RS:1;jenkins-hbase4:43213] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43213 2023-02-11 15:03:34,643 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43213,1676127807466 2023-02-11 15:03:34,643 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:34,643 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a9eb712 rejected from java.util.concurrent.ThreadPoolExecutor@ea12299[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,647 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43213,1676127807466] 2023-02-11 15:03:34,647 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43213,1676127807466; numProcessing=2 2023-02-11 15:03:34,651 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43213,1676127807466 already deleted, retry=false 2023-02-11 15:03:34,651 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43213,1676127807466 expired; onlineServers=0 2023-02-11 15:03:34,651 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35867,1676127807371' ***** 2023-02-11 15:03:34,652 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:34,652 DEBUG [M:0;jenkins-hbase4:35867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33070fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:34,653 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35867,1676127807371 2023-02-11 15:03:34,653 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35867,1676127807371; all regions closed. 2023-02-11 15:03:34,653 DEBUG [M:0;jenkins-hbase4:35867] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:34,653 DEBUG [M:0;jenkins-hbase4:35867] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:34,653 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:34,653 DEBUG [M:0;jenkins-hbase4:35867] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:34,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127807637] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127807637,5,FailOnTimeoutGroup] 2023-02-11 15:03:34,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127807637] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127807637,5,FailOnTimeoutGroup] 2023-02-11 15:03:34,653 INFO [M:0;jenkins-hbase4:35867] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:34,654 INFO [M:0;jenkins-hbase4:35867] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:34,654 INFO [M:0;jenkins-hbase4:35867] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:34,654 DEBUG [M:0;jenkins-hbase4:35867] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:34,654 INFO [M:0;jenkins-hbase4:35867] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:34,655 ERROR [M:0;jenkins-hbase4:35867] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 15:03:34,655 INFO [M:0;jenkins-hbase4:35867] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:34,655 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:34,657 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:34,657 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:34,657 DEBUG [M:0;jenkins-hbase4:35867] zookeeper.ZKUtil(398): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:34,657 WARN [M:0;jenkins-hbase4:35867] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:34,657 INFO [M:0;jenkins-hbase4:35867] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:34,657 INFO [M:0;jenkins-hbase4:35867] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:34,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:34,658 DEBUG [M:0;jenkins-hbase4:35867] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:34,658 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:34,658 DEBUG [M:0;jenkins-hbase4:35867] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:34,658 DEBUG [M:0;jenkins-hbase4:35867] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:34,658 DEBUG [M:0;jenkins-hbase4:35867] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:34,658 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.02 KB 2023-02-11 15:03:34,666 INFO [M:0;jenkins-hbase4:35867] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c4fb39ae300949a1872019e58bd28bf4 2023-02-11 15:03:34,670 DEBUG [M:0;jenkins-hbase4:35867] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c4fb39ae300949a1872019e58bd28bf4 as hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c4fb39ae300949a1872019e58bd28bf4 2023-02-11 15:03:34,673 INFO [M:0;jenkins-hbase4:35867] regionserver.HStore(1080): Added hdfs://localhost:34633/user/jenkins/test-data/8251bcc2-2445-c10c-9955-14970b64d35a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c4fb39ae300949a1872019e58bd28bf4, entries=53, sequenceid=357, filesize=10.7 K 2023-02-11 15:03:34,674 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171130, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-11 15:03:34,674 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:34,674 DEBUG [M:0;jenkins-hbase4:35867] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127814658Disabling compacts and flushes for region at 1676127814658Disabling writes for close at 1676127814658Obtaining lock to block concurrent updates at 1676127814658Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127814658Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171130, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1676127814658Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127814659 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127814659Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127814661 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127814661Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127814670 (+9 ms)Finished flush of dataSize ~167.12 KB/171130, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1676127814674 (+4 ms)Writing region close event to WAL at 1676127814674Closed at 1676127814674 2023-02-11 15:03:34,677 INFO [M:0;jenkins-hbase4:35867] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:34,677 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:34,678 INFO [M:0;jenkins-hbase4:35867] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35867 2023-02-11 15:03:34,681 DEBUG [M:0;jenkins-hbase4:35867] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35867,1676127807371 already deleted, retry=false 2023-02-11 15:03:34,747 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:34,747 INFO [RS:1;jenkins-hbase4:43213] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43213,1676127807466; zookeeper connection closed. 2023-02-11 15:03:34,747 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57bb3b5 rejected from java.util.concurrent.ThreadPoolExecutor@ea12299[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,748 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): regionserver:43213-0x10043e891360002, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:34,748 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d6deffb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d6deffb 2023-02-11 15:03:34,748 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d10e218 rejected from java.util.concurrent.ThreadPoolExecutor@ea12299[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,748 INFO [Listener at localhost/35071] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:34,848 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:34,848 INFO [M:0;jenkins-hbase4:35867] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35867,1676127807371; zookeeper connection closed. 2023-02-11 15:03:34,848 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fb133ac rejected from java.util.concurrent.ThreadPoolExecutor@b8eb682[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,849 DEBUG [Listener at localhost/35071-EventThread] zookeeper.ZKWatcher(600): master:35867-0x10043e891360000, quorum=127.0.0.1:59327, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:34,849 ERROR [Listener at localhost/35071-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7922e4f9 rejected from java.util.concurrent.ThreadPoolExecutor@b8eb682[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:34,849 WARN [Listener at localhost/35071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:34,852 INFO [Listener at localhost/35071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:34,957 WARN [BP-1447144949-172.31.14.131-1676127806753 heartbeating to localhost/127.0.0.1:34633] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:34,959 WARN [BP-1447144949-172.31.14.131-1676127806753 heartbeating to localhost/127.0.0.1:34633] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1447144949-172.31.14.131-1676127806753 (Datanode Uuid 619f54d6-785b-47f6-936d-a21beef18ad5) service to localhost/127.0.0.1:34633 2023-02-11 15:03:34,962 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/dfs/data/data3/current/BP-1447144949-172.31.14.131-1676127806753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:34,962 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/dfs/data/data4/current/BP-1447144949-172.31.14.131-1676127806753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:34,963 WARN [Listener at localhost/35071] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:34,968 INFO [Listener at localhost/35071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:35,073 WARN [BP-1447144949-172.31.14.131-1676127806753 heartbeating to localhost/127.0.0.1:34633] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:35,073 WARN [BP-1447144949-172.31.14.131-1676127806753 heartbeating to localhost/127.0.0.1:34633] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1447144949-172.31.14.131-1676127806753 (Datanode Uuid 611007dc-3d1e-4142-bd33-78cc92fb4498) service to localhost/127.0.0.1:34633 2023-02-11 15:03:35,074 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/dfs/data/data1/current/BP-1447144949-172.31.14.131-1676127806753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:35,074 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/cluster_e0d52e71-a477-dc00-9ea6-09c36820ec08/dfs/data/data2/current/BP-1447144949-172.31.14.131-1676127806753] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:35,085 INFO [Listener at localhost/35071] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:35,215 INFO [Listener at localhost/35071] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:35,268 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:35,283 INFO [Listener at localhost/35071] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:34633 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:34633 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34633 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:34633 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:34633 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35071.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,35867,1676127807371)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:34633 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:34633 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=627 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 249), ProcessCount=167 (was 168), AvailableMemoryMB=3875 (was 3974) 2023-02-11 15:03:35,293 INFO [Listener at localhost/35071] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=234, ProcessCount=167, AvailableMemoryMB=3875 2023-02-11 15:03:35,303 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/hadoop.log.dir so I do NOT create it in target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933 2023-02-11 15:03:35,303 WARN [Listener at localhost/35071] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 15:03:35,303 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/hadoop.tmp.dir so I do NOT create it in target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933 2023-02-11 15:03:35,303 WARN [Listener at localhost/35071] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a7585420-7f2a-2695-323f-acac12e69e23/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 15:03:35,304 DEBUG [Listener at localhost/35071] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d, deleteOnExit=true 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/test.cache.data in system properties and HBase conf 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:03:35,304 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:03:35,305 DEBUG [Listener at localhost/35071] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:35,305 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:03:35,306 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:03:35,306 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:03:35,306 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:35,306 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:03:35,306 INFO [Listener at localhost/35071] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:03:35,310 WARN [Listener at localhost/35071] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:35,310 WARN [Listener at localhost/35071] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:35,349 WARN [Listener at localhost/35071] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:35,352 INFO [Listener at localhost/35071] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:35,359 INFO [Listener at localhost/35071] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/java.io.tmpdir/Jetty_localhost_42987_hdfs____.rp5va4/webapp 2023-02-11 15:03:35,450 INFO [Listener at localhost/35071] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42987 2023-02-11 15:03:35,454 WARN [Listener at localhost/35071] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:35,455 WARN [Listener at localhost/35071] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:35,494 WARN [Listener at localhost/38383] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:35,506 WARN [Listener at localhost/38383] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:35,509 WARN [Listener at localhost/38383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:35,511 INFO [Listener at localhost/38383] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:35,517 INFO [Listener at localhost/38383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/java.io.tmpdir/Jetty_localhost_45951_datanode____6lctwb/webapp 2023-02-11 15:03:35,608 INFO [Listener at localhost/38383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45951 2023-02-11 15:03:35,615 WARN [Listener at localhost/42083] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:35,627 WARN [Listener at localhost/42083] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:35,629 WARN [Listener at localhost/42083] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:35,630 INFO [Listener at localhost/42083] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:35,633 INFO [Listener at localhost/42083] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/java.io.tmpdir/Jetty_localhost_37613_datanode____.cp89id/webapp 2023-02-11 15:03:35,691 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:35,727 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24cbfde6ec1652f5: Processing first storage report for DS-0828c067-c677-42b4-bfea-ba45931f75c7 from datanode 352dff4c-baf2-4975-98c8-b60c024489ca 2023-02-11 15:03:35,727 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24cbfde6ec1652f5: from storage DS-0828c067-c677-42b4-bfea-ba45931f75c7 node DatanodeRegistration(127.0.0.1:38743, datanodeUuid=352dff4c-baf2-4975-98c8-b60c024489ca, infoPort=33423, infoSecurePort=0, ipcPort=42083, storageInfo=lv=-57;cid=testClusterID;nsid=788514622;c=1676127815312), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 15:03:35,727 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x24cbfde6ec1652f5: Processing first storage report for DS-8df074f2-8a0d-4669-be9f-e46393025e1f from datanode 352dff4c-baf2-4975-98c8-b60c024489ca 2023-02-11 15:03:35,727 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x24cbfde6ec1652f5: from storage DS-8df074f2-8a0d-4669-be9f-e46393025e1f node DatanodeRegistration(127.0.0.1:38743, datanodeUuid=352dff4c-baf2-4975-98c8-b60c024489ca, infoPort=33423, infoSecurePort=0, ipcPort=42083, storageInfo=lv=-57;cid=testClusterID;nsid=788514622;c=1676127815312), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:35,732 INFO [Listener at localhost/42083] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37613 2023-02-11 15:03:35,741 WARN [Listener at localhost/43407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:35,849 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x785f8f64ea3db6d6: Processing first storage report for DS-ccfbe97f-ee77-43ec-916c-261e314f20b7 from datanode 5e81ffde-986c-41e8-8f55-c31106eea641 2023-02-11 15:03:35,849 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x785f8f64ea3db6d6: from storage DS-ccfbe97f-ee77-43ec-916c-261e314f20b7 node DatanodeRegistration(127.0.0.1:41847, datanodeUuid=5e81ffde-986c-41e8-8f55-c31106eea641, infoPort=45411, infoSecurePort=0, ipcPort=43407, storageInfo=lv=-57;cid=testClusterID;nsid=788514622;c=1676127815312), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:35,849 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x785f8f64ea3db6d6: Processing first storage report for DS-c4925147-7101-488e-9213-1d584317e2c8 from datanode 5e81ffde-986c-41e8-8f55-c31106eea641 2023-02-11 15:03:35,849 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x785f8f64ea3db6d6: from storage DS-c4925147-7101-488e-9213-1d584317e2c8 node DatanodeRegistration(127.0.0.1:41847, datanodeUuid=5e81ffde-986c-41e8-8f55-c31106eea641, infoPort=45411, infoSecurePort=0, ipcPort=43407, storageInfo=lv=-57;cid=testClusterID;nsid=788514622;c=1676127815312), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:35,949 DEBUG [Listener at localhost/43407] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933 2023-02-11 15:03:35,951 INFO [Listener at localhost/43407] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/zookeeper_0, clientPort=61087, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:03:35,952 INFO [Listener at localhost/43407] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61087 2023-02-11 15:03:35,953 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:35,953 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:35,967 INFO [Listener at localhost/43407] util.FSUtils(479): Created version file at hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de with version=8 2023-02-11 15:03:35,967 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:35,968 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:35,970 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/hbase-staging 2023-02-11 15:03:35,972 INFO [Listener at localhost/43407] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:35,972 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:35,972 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:35,972 INFO [Listener at localhost/43407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:35,972 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:35,973 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:35,973 INFO [Listener at localhost/43407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:35,973 INFO [Listener at localhost/43407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43115 2023-02-11 15:03:35,974 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:35,975 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:35,976 INFO [Listener at localhost/43407] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43115 connecting to ZooKeeper ensemble=127.0.0.1:61087 2023-02-11 15:03:35,983 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:431150x0, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:35,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43115-0x10043e8b2d40000 connected 2023-02-11 15:03:36,001 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:36,002 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:36,002 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:36,004 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43115 2023-02-11 15:03:36,004 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43115 2023-02-11 15:03:36,005 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43115 2023-02-11 15:03:36,007 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43115 2023-02-11 15:03:36,008 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43115 2023-02-11 15:03:36,008 INFO [Listener at localhost/43407] master.HMaster(439): hbase.rootdir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de, hbase.cluster.distributed=false 2023-02-11 15:03:36,022 INFO [Listener at localhost/43407] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:36,022 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:36,022 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:36,022 INFO [Listener at localhost/43407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:36,023 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:36,023 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:36,023 INFO [Listener at localhost/43407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:36,023 INFO [Listener at localhost/43407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33229 2023-02-11 15:03:36,024 INFO [Listener at localhost/43407] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:36,027 DEBUG [Listener at localhost/43407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:36,027 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:36,028 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:36,029 INFO [Listener at localhost/43407] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33229 connecting to ZooKeeper ensemble=127.0.0.1:61087 2023-02-11 15:03:36,032 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:332290x0, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:36,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33229-0x10043e8b2d40001 connected 2023-02-11 15:03:36,034 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:36,035 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:36,035 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:36,036 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33229 2023-02-11 15:03:36,036 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33229 2023-02-11 15:03:36,040 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33229 2023-02-11 15:03:36,044 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33229 2023-02-11 15:03:36,044 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33229 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:36,056 INFO [Listener at localhost/43407] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:36,057 INFO [Listener at localhost/43407] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40343 2023-02-11 15:03:36,057 INFO [Listener at localhost/43407] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:36,058 DEBUG [Listener at localhost/43407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:36,058 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:36,059 INFO [Listener at localhost/43407] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:36,059 INFO [Listener at localhost/43407] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40343 connecting to ZooKeeper ensemble=127.0.0.1:61087 2023-02-11 15:03:36,063 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:403430x0, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:36,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40343-0x10043e8b2d40002 connected 2023-02-11 15:03:36,065 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:36,065 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:36,066 DEBUG [Listener at localhost/43407] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:36,066 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40343 2023-02-11 15:03:36,066 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40343 2023-02-11 15:03:36,068 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40343 2023-02-11 15:03:36,072 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40343 2023-02-11 15:03:36,072 DEBUG [Listener at localhost/43407] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40343 2023-02-11 15:03:36,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,079 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:36,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,080 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:36,080 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:36,080 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:36,081 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:36,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43115,1676127815971 from backup master directory 2023-02-11 15:03:36,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:36,084 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,084 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:36,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,084 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:36,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/hbase.id with ID: 1d56777d-381e-4a40-a032-fe9b2247937f 2023-02-11 15:03:36,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:36,106 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x601b9dee to 127.0.0.1:61087 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:36,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@750295e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:36,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:36,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:03:36,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:36,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store-tmp 2023-02-11 15:03:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:36,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:36,128 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:36,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127816128Disabling compacts and flushes for region at 1676127816128Disabling writes for close at 1676127816128Writing region close event to WAL at 1676127816128Closed at 1676127816128 2023-02-11 15:03:36,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/WALs/jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43115%2C1676127815971, suffix=, logDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/WALs/jenkins-hbase4.apache.org,43115,1676127815971, archiveDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/oldWALs, maxLogs=10 2023-02-11 15:03:36,145 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK] 2023-02-11 15:03:36,145 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK] 2023-02-11 15:03:36,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/WALs/jenkins-hbase4.apache.org,43115,1676127815971/jenkins-hbase4.apache.org%2C43115%2C1676127815971.1676127816131 2023-02-11 15:03:36,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK], DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK]] 2023-02-11 15:03:36,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:36,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:36,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:36,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:36,149 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:36,150 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:03:36,150 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:03:36,150 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:36,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:36,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:36,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:36,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74345567, jitterRate=0.10783527791500092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:36,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127816148Initializing all the Stores at 1676127816148Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127816148Cleaning up temporary data from old regions at 1676127816151 (+3 ms)Cleaning up detritus from prior splits at 1676127816152 (+1 ms)Region opened successfully at 1676127816154 (+2 ms) 2023-02-11 15:03:36,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:03:36,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:03:36,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:03:36,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:03:36,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 15:03:36,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 15:03:36,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:03:36,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:03:36,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:03:36,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:03:36,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:03:36,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:03:36,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:03:36,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:03:36,171 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:03:36,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:03:36,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:03:36,173 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:36,173 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:36,173 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,173 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:36,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43115,1676127815971, sessionid=0x10043e8b2d40000, setting cluster-up flag (Was=false) 2023-02-11 15:03:36,180 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:03:36,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,188 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:03:36,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:36,193 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.hbase-snapshot/.tmp 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:36,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127846197 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:03:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,197 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:36,197 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:03:36,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:03:36,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:03:36,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:03:36,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:03:36,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:03:36,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127816198,5,FailOnTimeoutGroup] 2023-02-11 15:03:36,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127816199,5,FailOnTimeoutGroup] 2023-02-11 15:03:36,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:03:36,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,199 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:36,209 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:36,209 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:36,209 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de 2023-02-11 15:03:36,222 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:36,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:36,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/info 2023-02-11 15:03:36,234 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:36,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:36,235 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:36,236 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:36,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:36,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/table 2023-02-11 15:03:36,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:36,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,238 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740 2023-02-11 15:03:36,238 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740 2023-02-11 15:03:36,240 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:36,241 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:36,242 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:36,242 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61123078, jitterRate=-0.08919516205787659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:36,242 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127816222Initializing all the Stores at 1676127816228 (+6 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127816228Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127816232 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127816232Cleaning up temporary data from old regions at 1676127816239 (+7 ms)Cleaning up detritus from prior splits at 1676127816239Region opened successfully at 1676127816242 (+3 ms) 2023-02-11 15:03:36,242 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:36,242 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:36,242 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:36,242 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:36,242 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:36,243 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:36,243 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127816242Disabling compacts and flushes for region at 1676127816242Disabling writes for close at 1676127816242Writing region close event to WAL at 1676127816243 (+1 ms)Closed at 1676127816243 2023-02-11 15:03:36,243 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:36,243 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:03:36,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:03:36,245 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:03:36,246 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:03:36,274 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(952): ClusterId : 1d56777d-381e-4a40-a032-fe9b2247937f 2023-02-11 15:03:36,274 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(952): ClusterId : 1d56777d-381e-4a40-a032-fe9b2247937f 2023-02-11 15:03:36,274 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:36,275 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:36,277 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:36,277 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:36,277 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:36,277 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:36,279 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:36,281 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:36,281 DEBUG [RS:1;jenkins-hbase4:40343] zookeeper.ReadOnlyZKClient(139): Connect 0x776033df to 127.0.0.1:61087 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:36,282 DEBUG [RS:0;jenkins-hbase4:33229] zookeeper.ReadOnlyZKClient(139): Connect 0x3bf28e10 to 127.0.0.1:61087 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:36,292 DEBUG [RS:0;jenkins-hbase4:33229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3535771e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:36,292 DEBUG [RS:0;jenkins-hbase4:33229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@310ae560, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:36,292 DEBUG [RS:1;jenkins-hbase4:40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a7c343, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:36,292 DEBUG [RS:1;jenkins-hbase4:40343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d9858af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:36,301 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33229 2023-02-11 15:03:36,301 INFO [RS:0;jenkins-hbase4:33229] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:36,301 INFO [RS:0;jenkins-hbase4:33229] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:36,301 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:36,302 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43115,1676127815971 with isa=jenkins-hbase4.apache.org/172.31.14.131:33229, startcode=1676127816022 2023-02-11 15:03:36,302 DEBUG [RS:0;jenkins-hbase4:33229] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:36,303 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40343 2023-02-11 15:03:36,303 INFO [RS:1;jenkins-hbase4:40343] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:36,303 INFO [RS:1;jenkins-hbase4:40343] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:36,303 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:36,303 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51949, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:36,304 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43115,1676127815971 with isa=jenkins-hbase4.apache.org/172.31.14.131:40343, startcode=1676127816055 2023-02-11 15:03:36,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,305 DEBUG [RS:1;jenkins-hbase4:40343] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:36,305 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de 2023-02-11 15:03:36,305 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38383 2023-02-11 15:03:36,305 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:36,306 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60791, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:36,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,307 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:36,307 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de 2023-02-11 15:03:36,308 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38383 2023-02-11 15:03:36,308 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:36,308 DEBUG [RS:0;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,308 WARN [RS:0;jenkins-hbase4:33229] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:36,308 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33229,1676127816022] 2023-02-11 15:03:36,308 INFO [RS:0;jenkins-hbase4:33229] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:36,308 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,312 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:36,313 DEBUG [RS:1;jenkins-hbase4:40343] zookeeper.ZKUtil(162): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,313 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40343,1676127816055] 2023-02-11 15:03:36,313 WARN [RS:1;jenkins-hbase4:40343] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:36,313 INFO [RS:1;jenkins-hbase4:40343] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:36,313 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,313 DEBUG [RS:0;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,315 DEBUG [RS:0;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,317 DEBUG [RS:0;jenkins-hbase4:33229] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:36,317 INFO [RS:0;jenkins-hbase4:33229] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:36,317 DEBUG [RS:1;jenkins-hbase4:40343] zookeeper.ZKUtil(162): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,318 DEBUG [RS:1;jenkins-hbase4:40343] zookeeper.ZKUtil(162): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,318 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:36,318 INFO [RS:1;jenkins-hbase4:40343] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:36,319 INFO [RS:0;jenkins-hbase4:33229] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:36,319 INFO [RS:0;jenkins-hbase4:33229] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:36,319 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,320 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:36,320 INFO [RS:1;jenkins-hbase4:40343] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:36,320 INFO [RS:1;jenkins-hbase4:40343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:36,320 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,320 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:36,321 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,321 DEBUG [RS:1;jenkins-hbase4:40343] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,322 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,322 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,322 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,324 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,324 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,324 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,324 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,324 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,324 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,325 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:36,325 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,325 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,325 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,325 DEBUG [RS:0;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:36,327 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,327 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,327 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,333 INFO [RS:1;jenkins-hbase4:40343] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:36,333 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40343,1676127816055-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,338 INFO [RS:0;jenkins-hbase4:33229] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:36,338 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33229,1676127816022-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,344 INFO [RS:1;jenkins-hbase4:40343] regionserver.Replication(203): jenkins-hbase4.apache.org,40343,1676127816055 started 2023-02-11 15:03:36,344 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40343,1676127816055, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40343, sessionid=0x10043e8b2d40002 2023-02-11 15:03:36,344 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:36,344 DEBUG [RS:1;jenkins-hbase4:40343] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,344 DEBUG [RS:1;jenkins-hbase4:40343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40343,1676127816055' 2023-02-11 15:03:36,344 DEBUG [RS:1;jenkins-hbase4:40343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40343,1676127816055' 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:36,345 DEBUG [RS:1;jenkins-hbase4:40343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:36,346 DEBUG [RS:1;jenkins-hbase4:40343] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:36,346 INFO [RS:1;jenkins-hbase4:40343] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:36,346 INFO [RS:1;jenkins-hbase4:40343] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:36,348 INFO [RS:0;jenkins-hbase4:33229] regionserver.Replication(203): jenkins-hbase4.apache.org,33229,1676127816022 started 2023-02-11 15:03:36,348 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33229,1676127816022, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33229, sessionid=0x10043e8b2d40001 2023-02-11 15:03:36,348 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:36,348 DEBUG [RS:0;jenkins-hbase4:33229] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,348 DEBUG [RS:0;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33229,1676127816022' 2023-02-11 15:03:36,348 DEBUG [RS:0;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33229,1676127816022' 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:36,349 DEBUG [RS:0;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:36,350 DEBUG [RS:0;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:36,350 INFO [RS:0;jenkins-hbase4:33229] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:36,350 INFO [RS:0;jenkins-hbase4:33229] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:36,396 DEBUG [jenkins-hbase4:43115] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:03:36,397 DEBUG [jenkins-hbase4:43115] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:36,398 DEBUG [jenkins-hbase4:43115] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:36,398 DEBUG [jenkins-hbase4:43115] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:36,398 DEBUG [jenkins-hbase4:43115] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:36,398 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40343,1676127816055, state=OPENING 2023-02-11 15:03:36,399 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:03:36,401 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:36,401 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:36,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40343,1676127816055}] 2023-02-11 15:03:36,559 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,559 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:36,561 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36656, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:36,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:03:36,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:36,565 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40343%2C1676127816055.meta, suffix=.meta, logDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,40343,1676127816055, archiveDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/oldWALs, maxLogs=32 2023-02-11 15:03:36,579 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK] 2023-02-11 15:03:36,579 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK] 2023-02-11 15:03:36,581 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,40343,1676127816055/jenkins-hbase4.apache.org%2C40343%2C1676127816055.meta.1676127816566.meta 2023-02-11 15:03:36,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK], DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK]] 2023-02-11 15:03:36,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:36,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:03:36,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:03:36,581 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:03:36,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:03:36,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:36,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:03:36,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:03:36,583 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:36,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/info 2023-02-11 15:03:36,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/info 2023-02-11 15:03:36,584 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:36,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:36,585 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:36,585 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:36,585 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:36,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:36,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/table 2023-02-11 15:03:36,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/table 2023-02-11 15:03:36,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:36,587 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,588 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740 2023-02-11 15:03:36,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740 2023-02-11 15:03:36,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:36,592 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:36,592 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60048048, jitterRate=-0.10521435737609863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:36,593 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127816582Writing region info on filesystem at 1676127816582Initializing all the Stores at 1676127816582Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127816582Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127816582Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127816582Cleaning up temporary data from old regions at 1676127816590 (+8 ms)Cleaning up detritus from prior splits at 1676127816590Running coprocessor post-open hooks at 1676127816593 (+3 ms)Region opened successfully at 1676127816593 2023-02-11 15:03:36,593 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127816559 2023-02-11 15:03:36,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:03:36,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:03:36,597 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40343,1676127816055, state=OPEN 2023-02-11 15:03:36,599 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:03:36,599 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:36,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:03:36,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40343,1676127816055 in 198 msec 2023-02-11 15:03:36,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:03:36,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-11 15:03:36,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 409 msec 2023-02-11 15:03:36,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127816079, completionTime=-1 2023-02-11 15:03:36,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:03:36,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:03:36,606 DEBUG [hconnection-0x6baa37a1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:36,607 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:36,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:03:36,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127876608 2023-02-11 15:03:36,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127936608 2023-02-11 15:03:36,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43115,1676127815971-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43115,1676127815971-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43115,1676127815971-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43115, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:03:36,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:36,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:03:36,617 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:03:36,617 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:36,617 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:36,619 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,619 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d empty. 2023-02-11 15:03:36,619 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,619 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:03:36,630 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:36,631 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c2d77326435d410056dba6fc0e0f089d, NAME => 'hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp 2023-02-11 15:03:36,637 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:36,637 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c2d77326435d410056dba6fc0e0f089d, disabling compactions & flushes 2023-02-11 15:03:36,637 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,637 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,637 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. after waiting 0 ms 2023-02-11 15:03:36,637 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,637 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,637 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c2d77326435d410056dba6fc0e0f089d: Waiting for close lock at 1676127816637Disabling compacts and flushes for region at 1676127816637Disabling writes for close at 1676127816637Writing region close event to WAL at 1676127816637Closed at 1676127816637 2023-02-11 15:03:36,639 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:36,639 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127816639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127816639"}]},"ts":"1676127816639"} 2023-02-11 15:03:36,642 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:36,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:36,643 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127816642"}]},"ts":"1676127816642"} 2023-02-11 15:03:36,644 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:36,646 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:36,647 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:36,647 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:36,647 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:36,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c2d77326435d410056dba6fc0e0f089d, ASSIGN}] 2023-02-11 15:03:36,650 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c2d77326435d410056dba6fc0e0f089d, ASSIGN 2023-02-11 15:03:36,651 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c2d77326435d410056dba6fc0e0f089d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40343,1676127816055; forceNewPlan=false, retain=false 2023-02-11 15:03:36,801 INFO [jenkins-hbase4:43115] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:36,802 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c2d77326435d410056dba6fc0e0f089d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,802 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127816802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127816802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127816802"}]},"ts":"1676127816802"} 2023-02-11 15:03:36,804 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c2d77326435d410056dba6fc0e0f089d, server=jenkins-hbase4.apache.org,40343,1676127816055}] 2023-02-11 15:03:36,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,960 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40343%2C1676127816055, suffix=, logDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,40343,1676127816055, archiveDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/oldWALs, maxLogs=32 2023-02-11 15:03:36,977 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK] 2023-02-11 15:03:36,977 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK] 2023-02-11 15:03:36,979 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,40343,1676127816055/jenkins-hbase4.apache.org%2C40343%2C1676127816055.1676127816960 2023-02-11 15:03:36,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK]] 2023-02-11 15:03:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c2d77326435d410056dba6fc0e0f089d, NAME => 'hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,980 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,981 INFO [StoreOpener-c2d77326435d410056dba6fc0e0f089d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,983 DEBUG [StoreOpener-c2d77326435d410056dba6fc0e0f089d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/info 2023-02-11 15:03:36,983 DEBUG [StoreOpener-c2d77326435d410056dba6fc0e0f089d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/info 2023-02-11 15:03:36,983 INFO [StoreOpener-c2d77326435d410056dba6fc0e0f089d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2d77326435d410056dba6fc0e0f089d columnFamilyName info 2023-02-11 15:03:36,983 INFO [StoreOpener-c2d77326435d410056dba6fc0e0f089d-1] regionserver.HStore(310): Store=c2d77326435d410056dba6fc0e0f089d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:36,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:36,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:36,988 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c2d77326435d410056dba6fc0e0f089d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64097739, jitterRate=-0.044869258999824524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:36,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c2d77326435d410056dba6fc0e0f089d: Running coprocessor pre-open hook at 1676127816980Writing region info on filesystem at 1676127816980Initializing all the Stores at 1676127816981 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127816981Cleaning up temporary data from old regions at 1676127816985 (+4 ms)Cleaning up detritus from prior splits at 1676127816985Running coprocessor post-open hooks at 1676127816988 (+3 ms)Region opened successfully at 1676127816988 2023-02-11 15:03:36,989 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d., pid=6, masterSystemTime=1676127816956 2023-02-11 15:03:36,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,991 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:36,991 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c2d77326435d410056dba6fc0e0f089d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:36,992 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127816991"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127816991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127816991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127816991"}]},"ts":"1676127816991"} 2023-02-11 15:03:36,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:36,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c2d77326435d410056dba6fc0e0f089d, server=jenkins-hbase4.apache.org,40343,1676127816055 in 189 msec 2023-02-11 15:03:36,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:36,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c2d77326435d410056dba6fc0e0f089d, ASSIGN in 347 msec 2023-02-11 15:03:36,996 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:36,996 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127816996"}]},"ts":"1676127816996"} 2023-02-11 15:03:36,997 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:37,000 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:37,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 386 msec 2023-02-11 15:03:37,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:37,018 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:37,018 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:37,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:37,029 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:37,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 15:03:37,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:37,039 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:37,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-11 15:03:37,046 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:37,050 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:37,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.966sec 2023-02-11 15:03:37,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:37,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:37,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:37,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43115,1676127815971-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:37,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43115,1676127815971-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:37,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:37,075 DEBUG [Listener at localhost/43407] zookeeper.ReadOnlyZKClient(139): Connect 0x34860400 to 127.0.0.1:61087 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:37,082 DEBUG [Listener at localhost/43407] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2935a06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:37,084 DEBUG [hconnection-0x4e4c83c7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:37,085 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:37,087 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:37,087 DEBUG [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:37,089 DEBUG [Listener at localhost/43407] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:37,091 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41714, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:37,091 INFO [Listener at localhost/43407] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:37,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:41714 deadline: 1676127877092, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,093 INFO [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-11 15:03:37,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:37,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,097 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:37,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-11 15:03:37,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:37,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:37,100 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,100 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 empty. 2023-02-11 15:03:37,101 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,101 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-11 15:03:37,109 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:37,111 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => afd2823c0e49c491ed17f7647f9e6353, NAME => 'testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp 2023-02-11 15:03:37,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:37,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing afd2823c0e49c491ed17f7647f9e6353, disabling compactions & flushes 2023-02-11 15:03:37,118 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. after waiting 0 ms 2023-02-11 15:03:37,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,118 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,118 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for afd2823c0e49c491ed17f7647f9e6353: Waiting for close lock at 1676127817118Disabling compacts and flushes for region at 1676127817118Disabling writes for close at 1676127817118Writing region close event to WAL at 1676127817118Closed at 1676127817118 2023-02-11 15:03:37,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:37,121 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676127817121"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127817121"}]},"ts":"1676127817121"} 2023-02-11 15:03:37,132 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:37,133 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:37,133 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127817133"}]},"ts":"1676127817133"} 2023-02-11 15:03:37,134 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-11 15:03:37,138 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:37,139 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:37,139 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:37,139 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:37,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, ASSIGN}] 2023-02-11 15:03:37,141 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, ASSIGN 2023-02-11 15:03:37,142 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1676127816022; forceNewPlan=false, retain=false 2023-02-11 15:03:37,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:37,292 INFO [jenkins-hbase4:43115] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:37,292 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=afd2823c0e49c491ed17f7647f9e6353, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,292 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676127817292"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127817292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127817292"}]},"ts":"1676127817292"} 2023-02-11 15:03:37,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure afd2823c0e49c491ed17f7647f9e6353, server=jenkins-hbase4.apache.org,33229,1676127816022}] 2023-02-11 15:03:37,351 INFO [RS:0;jenkins-hbase4:33229] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33229%2C1676127816022, suffix=, logDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,33229,1676127816022, archiveDir=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/oldWALs, maxLogs=32 2023-02-11 15:03:37,369 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK] 2023-02-11 15:03:37,369 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK] 2023-02-11 15:03:37,372 INFO [RS:0;jenkins-hbase4:33229] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,33229,1676127816022/jenkins-hbase4.apache.org%2C33229%2C1676127816022.1676127817352 2023-02-11 15:03:37,372 DEBUG [RS:0;jenkins-hbase4:33229] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41847,DS-ccfbe97f-ee77-43ec-916c-261e314f20b7,DISK], DatanodeInfoWithStorage[127.0.0.1:38743,DS-0828c067-c677-42b4-bfea-ba45931f75c7,DISK]] 2023-02-11 15:03:37,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:37,447 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,448 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:37,449 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49460, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:37,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => afd2823c0e49c491ed17f7647f9e6353, NAME => 'testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,453 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,454 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1 2023-02-11 15:03:37,454 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1 2023-02-11 15:03:37,455 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afd2823c0e49c491ed17f7647f9e6353 columnFamilyName f1 2023-02-11 15:03:37,455 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(310): Store=afd2823c0e49c491ed17f7647f9e6353/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:37,455 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,456 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2 2023-02-11 15:03:37,457 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2 2023-02-11 15:03:37,457 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afd2823c0e49c491ed17f7647f9e6353 columnFamilyName f2 2023-02-11 15:03:37,457 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(310): Store=afd2823c0e49c491ed17f7647f9e6353/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:37,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:37,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:37,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:37,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened afd2823c0e49c491ed17f7647f9e6353; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68789830, jitterRate=0.02504834532737732}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:37,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for afd2823c0e49c491ed17f7647f9e6353: Running coprocessor pre-open hook at 1676127817452Writing region info on filesystem at 1676127817452Initializing all the Stores at 1676127817453 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127817453Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127817453Cleaning up temporary data from old regions at 1676127817458 (+5 ms)Cleaning up detritus from prior splits at 1676127817459 (+1 ms)Running coprocessor post-open hooks at 1676127817462 (+3 ms)Region opened successfully at 1676127817462 2023-02-11 15:03:37,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353., pid=12, masterSystemTime=1676127817447 2023-02-11 15:03:37,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,470 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=afd2823c0e49c491ed17f7647f9e6353, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,470 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676127817470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127817470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127817470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127817470"}]},"ts":"1676127817470"} 2023-02-11 15:03:37,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 15:03:37,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure afd2823c0e49c491ed17f7647f9e6353, server=jenkins-hbase4.apache.org,33229,1676127816022 in 177 msec 2023-02-11 15:03:37,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 15:03:37,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, ASSIGN in 333 msec 2023-02-11 15:03:37,474 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:37,475 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127817474"}]},"ts":"1676127817474"} 2023-02-11 15:03:37,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-11 15:03:37,477 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:37,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 382 msec 2023-02-11 15:03:37,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:37,704 INFO [Listener at localhost/43407] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-11 15:03:37,704 DEBUG [Listener at localhost/43407] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-11 15:03:37,704 INFO [Listener at localhost/43407] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:37,706 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-11 15:03:37,707 INFO [Listener at localhost/43407] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:37,707 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-11 15:03:37,707 INFO [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:37,796 DEBUG [hconnection-0x4e4c83c7-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:37,814 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49468, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:37,821 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,925 INFO [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:37,925 INFO [Listener at localhost/43407] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:37,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 15:03:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127817927 (current time:1676127817927). 2023-02-11 15:03:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] zookeeper.ReadOnlyZKClient(139): Connect 0x3090036d to 127.0.0.1:61087 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:37,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dc35b19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:37,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:37,933 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36676, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3090036d to 127.0.0.1:61087 2023-02-11 15:03:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 15:03:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 15:03:37,937 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 15:03:37,938 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676128417938 2023-02-11 15:03:37,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-11 15:03:37,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,939 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:37,939 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:37,940 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-11 15:03:37,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 15:03:37,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-11 15:03:37,942 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 15:03:37,942 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676128417942 2023-02-11 15:03:37,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,950 INFO [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-11 15:03:37,950 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:37,951 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-11 15:03:37,951 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 15:03:37,951 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,951 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,953 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:37,953 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:37,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:37,953 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:37,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:37,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:37,954 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,954 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-11 15:03:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-11 15:03:37,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-11 15:03:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:37,955 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-11 15:03:37,956 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 15:03:37,956 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 15:03:37,956 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:37,956 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40343,1676127816055' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 15:03:37,957 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 15:03:37,957 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 15:03:37,957 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1676127816022' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 15:03:37,958 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,958 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,958 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:37,958 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:37,958 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:37,959 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,959 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:37,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:37,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1676127816022' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-11 15:03:37,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f7ed981[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:37,961 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 15:03:37,961 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 15:03:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 15:03:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 15:03:37,962 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40343,1676127816055' in zk 2023-02-11 15:03:37,963 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:37,963 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:37,963 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 15:03:37,963 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:37,963 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:37,963 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. started... 2023-02-11 15:03:37,965 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 15:03:37,965 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:37,965 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 15:03:37,969 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HRegion(2744): Flushing afd2823c0e49c491ed17f7647f9e6353 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 15:03:37,986 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f1/857766a1fb9b41a9a60ce5b7aa305717 2023-02-11 15:03:38,014 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f2/2a65613ade194b1e94e732b940fc332a 2023-02-11 15:03:38,020 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f1/857766a1fb9b41a9a60ce5b7aa305717 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/857766a1fb9b41a9a60ce5b7aa305717 2023-02-11 15:03:38,024 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/857766a1fb9b41a9a60ce5b7aa305717, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:38,025 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f2/2a65613ade194b1e94e732b940fc332a as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/2a65613ade194b1e94e732b940fc332a 2023-02-11 15:03:38,030 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/2a65613ade194b1e94e732b940fc332a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:38,030 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for afd2823c0e49c491ed17f7647f9e6353 in 61ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:38,030 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for afd2823c0e49c491ed17f7647f9e6353: 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/857766a1fb9b41a9a60ce5b7aa305717] hfiles 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/857766a1fb9b41a9a60ce5b7aa305717 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/2a65613ade194b1e94e732b940fc332a] hfiles 2023-02-11 15:03:38,031 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/2a65613ade194b1e94e732b940fc332a for snapshot=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,040 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:38,041 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. completed. 2023-02-11 15:03:38,041 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 15:03:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 15:03:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 15:03:38,041 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33229,1676127816022' in zk 2023-02-11 15:03:38,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:38,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:38,042 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 15:03:38,043 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:38,043 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 15:03:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33229,1676127816022': 2023-02-11 15:03:38,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1676127816022' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:38,046 INFO [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-11 15:03:38,046 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:38,046 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:38,046 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,046 INFO [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:38,048 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:38,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,048 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:38,048 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:38,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:38,048 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:38,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,049 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,050 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:38,050 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:38,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:38,057 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:38,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:38,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:38,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:38,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:38,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:38,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:38,057 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,058 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,058 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,105 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-11 15:03:38,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,106 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676127817938Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676127818057 (+119 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676127818057Writing data manifest for testWithMockedMapReduceSingleRegion at 1676127818060 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676127818068 (+8 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676127818105 (+37 ms) 2023-02-11 15:03:38,108 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-11 15:03:38,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 169 msec 2023-02-11 15:03:38,242 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-11 15:03:38,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:38,244 INFO [Listener at localhost/43407] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:38,248 INFO [Listener at localhost/43407] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:38,253 INFO [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:38,289 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,402 INFO [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:38,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,409 INFO [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-11 15:03:38,409 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:38,410 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-11 15:03:38,410 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 15:03:38,412 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,412 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,413 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:38,413 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:38,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:38,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:38,413 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,414 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,414 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,415 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,415 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-11 15:03:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-11 15:03:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:38,416 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 15:03:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 15:03:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 15:03:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40343,1676127816055' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 15:03:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 15:03:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:38,417 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,417 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. started... 2023-02-11 15:03:38,417 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afd2823c0e49c491ed17f7647f9e6353 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 15:03:38,419 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:38,441 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f1/467f79db968b420c9ba2e8a4d7784bc9 2023-02-11 15:03:38,460 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f2/6e9f9026bb024da2b74c59718b00a159 2023-02-11 15:03:38,464 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f1/467f79db968b420c9ba2e8a4d7784bc9 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/467f79db968b420c9ba2e8a4d7784bc9 2023-02-11 15:03:38,468 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/467f79db968b420c9ba2e8a4d7784bc9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:38,469 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/.tmp/f2/6e9f9026bb024da2b74c59718b00a159 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/6e9f9026bb024da2b74c59718b00a159 2023-02-11 15:03:38,473 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/6e9f9026bb024da2b74c59718b00a159, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:38,474 INFO [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for afd2823c0e49c491ed17f7647f9e6353 in 57ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:38,475 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afd2823c0e49c491ed17f7647f9e6353: 2023-02-11 15:03:38,475 DEBUG [rs(jenkins-hbase4.apache.org,33229,1676127816022)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 15:03:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 15:03:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-11 15:03:38,475 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1676127816022' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-11 15:03:38,476 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:38,477 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,477 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:38,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1676127816022' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-11 15:03:38,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b415cb6[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:38,479 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 15:03:38,479 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,481 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,481 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 15:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 15:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 15:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-11 15:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,33229,1676127816022' in zk 2023-02-11 15:03:38,482 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,482 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:38,482 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40343,1676127816055' in zk 2023-02-11 15:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 15:03:38,483 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:38,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:38,483 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1676127816022' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 15:03:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-11 15:03:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,40343,1676127816055' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-11 15:03:38,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,33229,1676127816022': 2023-02-11 15:03:38,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1676127816022' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:38,488 INFO [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-11 15:03:38,489 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:38,489 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:38,489 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,489 INFO [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:38,490 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:38,490 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:38,491 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:38,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:38,491 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,493 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,493 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,496 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,496 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:38,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:38,496 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,496 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:38,496 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:38,496 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-11 15:03:38,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:38,497 DEBUG [(jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:38,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,497 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:38,598 DEBUG [Listener at localhost/43407] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:38,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:38,603 INFO [Listener at localhost/43407] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676127817927 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:38,603 DEBUG [Listener at localhost/43407] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2/data/default/testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,604 INFO [Listener at localhost/43407] snapshot.RestoreSnapshotHelper(239): region to add: afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:38,604 INFO [Listener at localhost/43407] snapshot.RestoreSnapshotHelper(585): clone region=afd2823c0e49c491ed17f7647f9e6353 as afd2823c0e49c491ed17f7647f9e6353 in snapshot testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,605 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => afd2823c0e49c491ed17f7647f9e6353, NAME => 'testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2 2023-02-11 15:03:38,611 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:38,611 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 857766a1fb9b41a9a60ce5b7aa305717 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,613 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2a65613ade194b1e94e732b940fc332a from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,614 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing afd2823c0e49c491ed17f7647f9e6353, disabling compactions & flushes 2023-02-11 15:03:38,614 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,614 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,614 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. after waiting 0 ms 2023-02-11 15:03:38,614 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,615 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,615 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for afd2823c0e49c491ed17f7647f9e6353: Waiting for close lock at 1676127818614Disabling compacts and flushes for region at 1676127818614Disabling writes for close at 1676127818614Writing region close event to WAL at 1676127818615 (+1 ms)Closed at 1676127818615 2023-02-11 15:03:38,615 INFO [Listener at localhost/43407] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676127817927 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:38,615 DEBUG [Listener at localhost/43407] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2 2023-02-11 15:03:38,615 DEBUG [Listener at localhost/43407] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2 2023-02-11 15:03:38,615 DEBUG [Listener at localhost/43407] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:38,616 DEBUG [Listener at localhost/43407] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:38,616 DEBUG [Listener at localhost/43407] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-11 15:03:38,616 DEBUG [Listener at localhost/43407] util.CommonFSUtils(699): |----------afd2823c0e49c491ed17f7647f9e6353/ 2023-02-11 15:03:38,617 DEBUG [Listener at localhost/43407] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:38,617 DEBUG [Listener at localhost/43407] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:38,617 DEBUG [Listener at localhost/43407] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=afd2823c0e49c491ed17f7647f9e6353-857766a1fb9b41a9a60ce5b7aa305717 2023-02-11 15:03:38,617 DEBUG [Listener at localhost/43407] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:38,617 DEBUG [Listener at localhost/43407] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=afd2823c0e49c491ed17f7647f9e6353-2a65613ade194b1e94e732b940fc332a 2023-02-11 15:03:38,620 INFO [Listener at localhost/43407] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 15:03:38,623 DEBUG [Listener at localhost/43407] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:38,623 INFO [Listener at localhost/43407] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:38,623 DEBUG [Listener at localhost/43407] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:38,625 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:38,626 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1 2023-02-11 15:03:38,626 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afd2823c0e49c491ed17f7647f9e6353 columnFamilyName f1 2023-02-11 15:03:38,629 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(539): loaded hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/testWithMockedMapReduceSingleRegion=afd2823c0e49c491ed17f7647f9e6353-857766a1fb9b41a9a60ce5b7aa305717 2023-02-11 15:03:38,630 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(310): Store=afd2823c0e49c491ed17f7647f9e6353/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:38,630 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:38,630 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2 2023-02-11 15:03:38,631 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afd2823c0e49c491ed17f7647f9e6353 columnFamilyName f2 2023-02-11 15:03:38,634 DEBUG [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(539): loaded hdfs://localhost:38383/user/jenkins/test-data/38dd3ff6-82e7-faf4-fa70-c018d198ca7d/testWithMockedMapReduceSingleRegion/0239c659-794a-4e97-be69-05886f9024e2/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/testWithMockedMapReduceSingleRegion=afd2823c0e49c491ed17f7647f9e6353-2a65613ade194b1e94e732b940fc332a 2023-02-11 15:03:38,634 INFO [StoreOpener-afd2823c0e49c491ed17f7647f9e6353-1] regionserver.HStore(310): Store=afd2823c0e49c491ed17f7647f9e6353/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:38,634 DEBUG [Listener at localhost/43407] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:38,634 INFO [Listener at localhost/43407] regionserver.HRegion(1071): Opened afd2823c0e49c491ed17f7647f9e6353; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67334668, jitterRate=0.003364741802215576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:38,634 DEBUG [Listener at localhost/43407] regionserver.HRegion(964): Region open journal for afd2823c0e49c491ed17f7647f9e6353: Writing region info on filesystem at 1676127818623Initializing all the Stores at 1676127818624 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127818624Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127818624Region opened successfully at 1676127818634 (+10 ms) 2023-02-11 15:03:38,682 DEBUG [Listener at localhost/43407] regionserver.HRegion(1603): Closing afd2823c0e49c491ed17f7647f9e6353, disabling compactions & flushes 2023-02-11 15:03:38,682 INFO [Listener at localhost/43407] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,682 DEBUG [Listener at localhost/43407] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,682 DEBUG [Listener at localhost/43407] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. after waiting 0 ms 2023-02-11 15:03:38,682 DEBUG [Listener at localhost/43407] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,683 INFO [Listener at localhost/43407] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,683 DEBUG [Listener at localhost/43407] regionserver.HRegion(1557): Region close journal for afd2823c0e49c491ed17f7647f9e6353: Waiting for close lock at 1676127818681Disabling compacts and flushes for region at 1676127818681Disabling writes for close at 1676127818682 (+1 ms)Writing region close event to WAL at 1676127818683 (+1 ms)Closed at 1676127818683 2023-02-11 15:03:38,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-11 15:03:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,693 INFO [Listener at localhost/43407] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:38,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:38,697 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127818697"}]},"ts":"1676127818697"} 2023-02-11 15:03:38,699 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-11 15:03:38,700 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-11 15:03:38,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, UNASSIGN}] 2023-02-11 15:03:38,702 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, UNASSIGN 2023-02-11 15:03:38,704 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=afd2823c0e49c491ed17f7647f9e6353, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:38,704 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676127818704"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127818704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127818704"}]},"ts":"1676127818704"} 2023-02-11 15:03:38,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure afd2823c0e49c491ed17f7647f9e6353, server=jenkins-hbase4.apache.org,33229,1676127816022}] 2023-02-11 15:03:38,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:38,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing afd2823c0e49c491ed17f7647f9e6353, disabling compactions & flushes 2023-02-11 15:03:38,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. after waiting 0 ms 2023-02-11 15:03:38,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:38,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353. 2023-02-11 15:03:38,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for afd2823c0e49c491ed17f7647f9e6353: Waiting for close lock at 1676127818857Running coprocessor pre-close hooks at 1676127818857Disabling compacts and flushes for region at 1676127818857Disabling writes for close at 1676127818857Writing region close event to WAL at 1676127818858 (+1 ms)Running coprocessor post-close hooks at 1676127818861 (+3 ms)Closed at 1676127818862 (+1 ms) 2023-02-11 15:03:38,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:38,864 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=afd2823c0e49c491ed17f7647f9e6353, regionState=CLOSED 2023-02-11 15:03:38,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676127818864"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127818864"}]},"ts":"1676127818864"} 2023-02-11 15:03:38,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 15:03:38,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure afd2823c0e49c491ed17f7647f9e6353, server=jenkins-hbase4.apache.org,33229,1676127816022 in 160 msec 2023-02-11 15:03:38,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 15:03:38,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=afd2823c0e49c491ed17f7647f9e6353, UNASSIGN in 166 msec 2023-02-11 15:03:38,870 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127818870"}]},"ts":"1676127818870"} 2023-02-11 15:03:38,872 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-11 15:03:38,874 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-11 15:03:38,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 181 msec 2023-02-11 15:03:39,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:39,001 INFO [Listener at localhost/43407] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-11 15:03:39,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,004 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,005 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:39,008 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:39,009 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1, FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2, FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/recovered.edits] 2023-02-11 15:03:39,012 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/467f79db968b420c9ba2e8a4d7784bc9 to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/archive/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/467f79db968b420c9ba2e8a4d7784bc9 2023-02-11 15:03:39,013 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/857766a1fb9b41a9a60ce5b7aa305717 to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/archive/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f1/857766a1fb9b41a9a60ce5b7aa305717 2023-02-11 15:03:39,015 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/2a65613ade194b1e94e732b940fc332a to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/archive/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/2a65613ade194b1e94e732b940fc332a 2023-02-11 15:03:39,017 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/6e9f9026bb024da2b74c59718b00a159 to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/archive/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/f2/6e9f9026bb024da2b74c59718b00a159 2023-02-11 15:03:39,019 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/recovered.edits/12.seqid to hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/archive/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353/recovered.edits/12.seqid 2023-02-11 15:03:39,020 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/.tmp/data/default/testWithMockedMapReduceSingleRegion/afd2823c0e49c491ed17f7647f9e6353 2023-02-11 15:03:39,020 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-11 15:03:39,022 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,023 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-11 15:03:39,025 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-11 15:03:39,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,026 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-11 15:03:39,026 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127819026"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:39,027 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 15:03:39,027 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => afd2823c0e49c491ed17f7647f9e6353, NAME => 'testWithMockedMapReduceSingleRegion,,1676127817095.afd2823c0e49c491ed17f7647f9e6353.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 15:03:39,027 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-11 15:03:39,027 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676127819027"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:39,028 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-11 15:03:39,030 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-11 15:03:39,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 29 msec 2023-02-11 15:03:39,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43115] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:39,107 INFO [Listener at localhost/43407] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-11 15:03:39,107 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:39,107 INFO [Listener at localhost/43407] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:39,107 DEBUG [Listener at localhost/43407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34860400 to 127.0.0.1:61087 2023-02-11 15:03:39,107 DEBUG [Listener at localhost/43407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,108 DEBUG [Listener at localhost/43407] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:39,108 DEBUG [Listener at localhost/43407] util.JVMClusterUtil(257): Found active master hash=1723161318, stopped=false 2023-02-11 15:03:39,108 INFO [Listener at localhost/43407] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:39,110 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:39,110 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:39,110 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:39,110 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:39,110 INFO [Listener at localhost/43407] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:39,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:39,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:39,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:39,112 DEBUG [Listener at localhost/43407] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x601b9dee to 127.0.0.1:61087 2023-02-11 15:03:39,112 DEBUG [Listener at localhost/43407] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,112 INFO [Listener at localhost/43407] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33229,1676127816022' ***** 2023-02-11 15:03:39,112 INFO [Listener at localhost/43407] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:39,113 INFO [Listener at localhost/43407] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40343,1676127816055' ***** 2023-02-11 15:03:39,113 INFO [Listener at localhost/43407] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:39,113 INFO [RS:0;jenkins-hbase4:33229] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:39,113 INFO [RS:1;jenkins-hbase4:40343] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:39,113 INFO [RS:1;jenkins-hbase4:40343] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:39,113 INFO [RS:1;jenkins-hbase4:40343] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:39,113 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:39,113 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(3304): Received CLOSE for c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:39,113 INFO [RS:0;jenkins-hbase4:33229] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:39,114 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:39,115 INFO [RS:0;jenkins-hbase4:33229] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:39,115 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:39,115 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:39,115 DEBUG [RS:1;jenkins-hbase4:40343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x776033df to 127.0.0.1:61087 2023-02-11 15:03:39,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c2d77326435d410056dba6fc0e0f089d, disabling compactions & flushes 2023-02-11 15:03:39,115 DEBUG [RS:0;jenkins-hbase4:33229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bf28e10 to 127.0.0.1:61087 2023-02-11 15:03:39,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:39,115 DEBUG [RS:1;jenkins-hbase4:40343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:39,115 DEBUG [RS:0;jenkins-hbase4:33229] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. after waiting 0 ms 2023-02-11 15:03:39,115 INFO [RS:1;jenkins-hbase4:40343] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:39,115 INFO [RS:1;jenkins-hbase4:40343] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:39,116 INFO [RS:1;jenkins-hbase4:40343] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:39,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:39,115 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33229,1676127816022; all regions closed. 2023-02-11 15:03:39,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c2d77326435d410056dba6fc0e0f089d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:39,116 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:39,116 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 15:03:39,116 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1479): Online Regions={c2d77326435d410056dba6fc0e0f089d=hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 15:03:39,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:39,116 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1505): Waiting on 1588230740, c2d77326435d410056dba6fc0e0f089d 2023-02-11 15:03:39,116 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:39,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:39,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:39,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:39,117 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-11 15:03:39,118 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/WALs/jenkins-hbase4.apache.org,33229,1676127816022/jenkins-hbase4.apache.org%2C33229%2C1676127816022.1676127817352 not finished, retry = 0 2023-02-11 15:03:39,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/.tmp/info/d67018feb87b4addbe51d4a0a4b0a741 2023-02-11 15:03:39,131 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/.tmp/info/f308c58e7066463fb87b0672d02b9841 2023-02-11 15:03:39,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f308c58e7066463fb87b0672d02b9841 2023-02-11 15:03:39,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/.tmp/info/d67018feb87b4addbe51d4a0a4b0a741 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/info/d67018feb87b4addbe51d4a0a4b0a741 2023-02-11 15:03:39,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/info/d67018feb87b4addbe51d4a0a4b0a741, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:39,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c2d77326435d410056dba6fc0e0f089d in 25ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:39,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/namespace/c2d77326435d410056dba6fc0e0f089d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:39,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:39,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c2d77326435d410056dba6fc0e0f089d: Waiting for close lock at 1676127819115Running coprocessor pre-close hooks at 1676127819115Disabling compacts and flushes for region at 1676127819115Disabling writes for close at 1676127819115Obtaining lock to block concurrent updates at 1676127819116 (+1 ms)Preparing flush snapshotting stores in c2d77326435d410056dba6fc0e0f089d at 1676127819116Finished memstore snapshotting hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127819116Flushing stores of hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. at 1676127819116Flushing c2d77326435d410056dba6fc0e0f089d/info: creating writer at 1676127819117 (+1 ms)Flushing c2d77326435d410056dba6fc0e0f089d/info: appending metadata at 1676127819121 (+4 ms)Flushing c2d77326435d410056dba6fc0e0f089d/info: closing flushed file at 1676127819121Flushing c2d77326435d410056dba6fc0e0f089d/info: reopening flushed file at 1676127819137 (+16 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c2d77326435d410056dba6fc0e0f089d in 25ms, sequenceid=6, compaction requested=false at 1676127819141 (+4 ms)Writing region close event to WAL at 1676127819145 (+4 ms)Running coprocessor post-close hooks at 1676127819148 (+3 ms)Closed at 1676127819148 2023-02-11 15:03:39,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127816615.c2d77326435d410056dba6fc0e0f089d. 2023-02-11 15:03:39,178 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:39,179 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:39,221 DEBUG [RS:0;jenkins-hbase4:33229] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/oldWALs 2023-02-11 15:03:39,221 INFO [RS:0;jenkins-hbase4:33229] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33229%2C1676127816022:(num 1676127817352) 2023-02-11 15:03:39,221 DEBUG [RS:0;jenkins-hbase4:33229] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,221 INFO [RS:0;jenkins-hbase4:33229] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:39,221 INFO [RS:0;jenkins-hbase4:33229] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:39,221 INFO [RS:0;jenkins-hbase4:33229] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:39,221 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:39,221 INFO [RS:0;jenkins-hbase4:33229] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:39,221 INFO [RS:0;jenkins-hbase4:33229] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:39,222 INFO [RS:0;jenkins-hbase4:33229] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33229 2023-02-11 15:03:39,226 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:39,226 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33229,1676127816022 2023-02-11 15:03:39,226 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:39,226 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:39,226 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ec7035 rejected from java.util.concurrent.ThreadPoolExecutor@7d3f490[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,227 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:39,227 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13d4392b rejected from java.util.concurrent.ThreadPoolExecutor@7d3f490[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,227 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33229,1676127816022] 2023-02-11 15:03:39,227 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33229,1676127816022; numProcessing=1 2023-02-11 15:03:39,229 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33229,1676127816022 already deleted, retry=false 2023-02-11 15:03:39,229 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33229,1676127816022 expired; onlineServers=1 2023-02-11 15:03:39,278 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:39,316 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:39,322 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 15:03:39,322 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 15:03:39,513 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:39,513 INFO [RS:0;jenkins-hbase4:33229] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33229,1676127816022; zookeeper connection closed. 2023-02-11 15:03:39,513 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b368323 rejected from java.util.concurrent.ThreadPoolExecutor@7d3f490[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,513 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x10043e8b2d40001, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:39,513 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@595408a6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@595408a6 2023-02-11 15:03:39,513 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10d1ed54 rejected from java.util.concurrent.ThreadPoolExecutor@7d3f490[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,517 DEBUG [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:39,553 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/.tmp/rep_barrier/d3a432f4f18c4e0c82658451c1a167d2 2023-02-11 15:03:39,557 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3a432f4f18c4e0c82658451c1a167d2 2023-02-11 15:03:39,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/.tmp/table/bb0ef5ebc1444c698a0b17e7432e5e49 2023-02-11 15:03:39,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb0ef5ebc1444c698a0b17e7432e5e49 2023-02-11 15:03:39,568 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/.tmp/info/f308c58e7066463fb87b0672d02b9841 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/info/f308c58e7066463fb87b0672d02b9841 2023-02-11 15:03:39,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f308c58e7066463fb87b0672d02b9841 2023-02-11 15:03:39,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/info/f308c58e7066463fb87b0672d02b9841, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 15:03:39,575 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/.tmp/rep_barrier/d3a432f4f18c4e0c82658451c1a167d2 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/rep_barrier/d3a432f4f18c4e0c82658451c1a167d2 2023-02-11 15:03:39,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3a432f4f18c4e0c82658451c1a167d2 2023-02-11 15:03:39,579 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/rep_barrier/d3a432f4f18c4e0c82658451c1a167d2, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 15:03:39,580 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/.tmp/table/bb0ef5ebc1444c698a0b17e7432e5e49 as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/table/bb0ef5ebc1444c698a0b17e7432e5e49 2023-02-11 15:03:39,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb0ef5ebc1444c698a0b17e7432e5e49 2023-02-11 15:03:39,583 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/table/bb0ef5ebc1444c698a0b17e7432e5e49, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 15:03:39,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 471ms, sequenceid=21, compaction requested=false 2023-02-11 15:03:39,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 15:03:39,592 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:39,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:39,593 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127819116Running coprocessor pre-close hooks at 1676127819116Disabling compacts and flushes for region at 1676127819116Disabling writes for close at 1676127819116Obtaining lock to block concurrent updates at 1676127819117 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676127819117Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676127819117Flushing stores of hbase:meta,,1.1588230740 at 1676127819117Flushing 1588230740/info: creating writer at 1676127819118 (+1 ms)Flushing 1588230740/info: appending metadata at 1676127819121 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676127819121Flushing 1588230740/rep_barrier: creating writer at 1676127819135 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676127819145 (+10 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676127819145Flushing 1588230740/table: creating writer at 1676127819557 (+412 ms)Flushing 1588230740/table: appending metadata at 1676127819559 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676127819559Flushing 1588230740/info: reopening flushed file at 1676127819569 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676127819575 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676127819580 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 471ms, sequenceid=21, compaction requested=false at 1676127819588 (+8 ms)Writing region close event to WAL at 1676127819588Running coprocessor post-close hooks at 1676127819592 (+4 ms)Closed at 1676127819593 (+1 ms) 2023-02-11 15:03:39,593 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:39,717 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40343,1676127816055; all regions closed. 2023-02-11 15:03:39,721 DEBUG [RS:1;jenkins-hbase4:40343] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/oldWALs 2023-02-11 15:03:39,721 INFO [RS:1;jenkins-hbase4:40343] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40343%2C1676127816055.meta:.meta(num 1676127816566) 2023-02-11 15:03:39,724 DEBUG [RS:1;jenkins-hbase4:40343] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/oldWALs 2023-02-11 15:03:39,724 INFO [RS:1;jenkins-hbase4:40343] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40343%2C1676127816055:(num 1676127816960) 2023-02-11 15:03:39,724 DEBUG [RS:1;jenkins-hbase4:40343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,724 INFO [RS:1;jenkins-hbase4:40343] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:39,725 INFO [RS:1;jenkins-hbase4:40343] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:39,725 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:39,726 INFO [RS:1;jenkins-hbase4:40343] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40343 2023-02-11 15:03:39,729 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:39,729 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40343,1676127816055 2023-02-11 15:03:39,729 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c214597 rejected from java.util.concurrent.ThreadPoolExecutor@781edecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,730 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40343,1676127816055] 2023-02-11 15:03:39,730 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40343,1676127816055; numProcessing=2 2023-02-11 15:03:39,731 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40343,1676127816055 already deleted, retry=false 2023-02-11 15:03:39,731 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40343,1676127816055 expired; onlineServers=0 2023-02-11 15:03:39,731 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43115,1676127815971' ***** 2023-02-11 15:03:39,731 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:39,732 DEBUG [M:0;jenkins-hbase4:43115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@628ad2e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:39,732 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43115,1676127815971 2023-02-11 15:03:39,732 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43115,1676127815971; all regions closed. 2023-02-11 15:03:39,732 DEBUG [M:0;jenkins-hbase4:43115] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:39,732 DEBUG [M:0;jenkins-hbase4:43115] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:39,732 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:39,732 DEBUG [M:0;jenkins-hbase4:43115] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:39,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127816199] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127816199,5,FailOnTimeoutGroup] 2023-02-11 15:03:39,732 INFO [M:0;jenkins-hbase4:43115] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:39,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127816198] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127816198,5,FailOnTimeoutGroup] 2023-02-11 15:03:39,733 INFO [M:0;jenkins-hbase4:43115] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:39,734 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:39,734 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:39,734 INFO [M:0;jenkins-hbase4:43115] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:39,734 DEBUG [M:0;jenkins-hbase4:43115] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:39,734 INFO [M:0;jenkins-hbase4:43115] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:39,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:39,735 ERROR [M:0;jenkins-hbase4:43115] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 15:03:39,735 INFO [M:0;jenkins-hbase4:43115] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:39,735 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:39,735 DEBUG [M:0;jenkins-hbase4:43115] zookeeper.ZKUtil(398): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:39,735 WARN [M:0;jenkins-hbase4:43115] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:39,735 INFO [M:0;jenkins-hbase4:43115] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:39,736 INFO [M:0;jenkins-hbase4:43115] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:39,736 DEBUG [M:0;jenkins-hbase4:43115] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:39,736 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:39,736 DEBUG [M:0;jenkins-hbase4:43115] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:39,736 DEBUG [M:0;jenkins-hbase4:43115] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:39,736 DEBUG [M:0;jenkins-hbase4:43115] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:39,736 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.14 KB heapSize=67.06 KB 2023-02-11 15:03:39,745 INFO [M:0;jenkins-hbase4:43115] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.14 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9089ab15d8264dffa80f67bd429a33bc 2023-02-11 15:03:39,749 DEBUG [M:0;jenkins-hbase4:43115] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9089ab15d8264dffa80f67bd429a33bc as hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9089ab15d8264dffa80f67bd429a33bc 2023-02-11 15:03:39,753 INFO [M:0;jenkins-hbase4:43115] regionserver.HStore(1080): Added hdfs://localhost:38383/user/jenkins/test-data/354e354c-09ed-f2d9-c5f3-cea1413d45de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9089ab15d8264dffa80f67bd429a33bc, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 15:03:39,754 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegion(2947): Finished flush of dataSize ~56.14 KB/57486, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-11 15:03:39,754 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:39,754 DEBUG [M:0;jenkins-hbase4:43115] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127819736Disabling compacts and flushes for region at 1676127819736Disabling writes for close at 1676127819736Obtaining lock to block concurrent updates at 1676127819736Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127819736Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57486, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676127819736Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127819737 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127819738 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127819740 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127819740Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127819750 (+10 ms)Finished flush of dataSize ~56.14 KB/57486, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676127819754 (+4 ms)Writing region close event to WAL at 1676127819754Closed at 1676127819754 2023-02-11 15:03:39,757 INFO [M:0;jenkins-hbase4:43115] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:39,757 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:39,758 INFO [M:0;jenkins-hbase4:43115] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43115 2023-02-11 15:03:39,761 DEBUG [M:0;jenkins-hbase4:43115] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43115,1676127815971 already deleted, retry=false 2023-02-11 15:03:39,830 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:39,830 INFO [RS:1;jenkins-hbase4:40343] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40343,1676127816055; zookeeper connection closed. 2023-02-11 15:03:39,830 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a107ed9 rejected from java.util.concurrent.ThreadPoolExecutor@781edecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,830 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): regionserver:40343-0x10043e8b2d40002, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:39,830 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20dfe21 rejected from java.util.concurrent.ThreadPoolExecutor@781edecb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,832 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f689fa4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f689fa4 2023-02-11 15:03:39,832 INFO [Listener at localhost/43407] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:39,930 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:39,930 INFO [M:0;jenkins-hbase4:43115] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43115,1676127815971; zookeeper connection closed. 2023-02-11 15:03:39,930 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c4e63f8 rejected from java.util.concurrent.ThreadPoolExecutor@4871fea9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,934 DEBUG [Listener at localhost/43407-EventThread] zookeeper.ZKWatcher(600): master:43115-0x10043e8b2d40000, quorum=127.0.0.1:61087, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:39,934 WARN [Listener at localhost/43407] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:39,934 ERROR [Listener at localhost/43407-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35a02e9 rejected from java.util.concurrent.ThreadPoolExecutor@4871fea9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:39,938 INFO [Listener at localhost/43407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:40,042 WARN [BP-368920819-172.31.14.131-1676127815312 heartbeating to localhost/127.0.0.1:38383] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:40,042 WARN [BP-368920819-172.31.14.131-1676127815312 heartbeating to localhost/127.0.0.1:38383] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-368920819-172.31.14.131-1676127815312 (Datanode Uuid 5e81ffde-986c-41e8-8f55-c31106eea641) service to localhost/127.0.0.1:38383 2023-02-11 15:03:40,043 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/dfs/data/data3/current/BP-368920819-172.31.14.131-1676127815312] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:40,043 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/dfs/data/data4/current/BP-368920819-172.31.14.131-1676127815312] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:40,044 WARN [Listener at localhost/43407] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:40,050 INFO [Listener at localhost/43407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:40,152 WARN [BP-368920819-172.31.14.131-1676127815312 heartbeating to localhost/127.0.0.1:38383] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:40,153 WARN [BP-368920819-172.31.14.131-1676127815312 heartbeating to localhost/127.0.0.1:38383] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-368920819-172.31.14.131-1676127815312 (Datanode Uuid 352dff4c-baf2-4975-98c8-b60c024489ca) service to localhost/127.0.0.1:38383 2023-02-11 15:03:40,155 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/dfs/data/data1/current/BP-368920819-172.31.14.131-1676127815312] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:40,155 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/cluster_0bf23f78-c699-5386-3819-94baaec2b56d/dfs/data/data2/current/BP-368920819-172.31.14.131-1676127815312] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:40,168 INFO [Listener at localhost/43407] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:40,285 INFO [Listener at localhost/43407] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:40,306 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:40,320 INFO [Listener at localhost/43407] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=255 (was 230) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38383 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:38383 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43407 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43407.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:38383 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43115,1676127815971)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:38383 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:38383 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:38383 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:38383 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=652 (was 627) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=271 (was 234) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=3813 (was 3875) 2023-02-11 15:03:40,332 INFO [Listener at localhost/43407] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=255, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=167, AvailableMemoryMB=3812 2023-02-11 15:03:40,342 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/hadoop.log.dir so I do NOT create it in target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a 2023-02-11 15:03:40,342 WARN [Listener at localhost/43407] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 15:03:40,342 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/hadoop.tmp.dir so I do NOT create it in target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a 2023-02-11 15:03:40,342 WARN [Listener at localhost/43407] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e33624dd-2571-ac16-1fba-8c97d33f5933/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 15:03:40,342 DEBUG [Listener at localhost/43407] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89, deleteOnExit=true 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/test.cache.data in system properties and HBase conf 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:03:40,343 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:03:40,343 DEBUG [Listener at localhost/43407] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:40,344 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:03:40,345 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:03:40,345 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:03:40,345 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:40,345 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:03:40,345 INFO [Listener at localhost/43407] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:03:40,349 WARN [Listener at localhost/43407] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:40,349 WARN [Listener at localhost/43407] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:40,400 WARN [Listener at localhost/43407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:40,402 INFO [Listener at localhost/43407] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:40,410 INFO [Listener at localhost/43407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/java.io.tmpdir/Jetty_localhost_43787_hdfs____xvemo1/webapp 2023-02-11 15:03:40,516 INFO [Listener at localhost/43407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43787 2023-02-11 15:03:40,521 WARN [Listener at localhost/43407] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:40,522 WARN [Listener at localhost/43407] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:40,572 WARN [Listener at localhost/44211] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:40,595 WARN [Listener at localhost/44211] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:40,600 WARN [Listener at localhost/44211] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:40,601 INFO [Listener at localhost/44211] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:40,607 INFO [Listener at localhost/44211] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/java.io.tmpdir/Jetty_localhost_33051_datanode____.a74p0t/webapp 2023-02-11 15:03:40,713 INFO [Listener at localhost/44211] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33051 2023-02-11 15:03:40,732 WARN [Listener at localhost/38665] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:40,757 WARN [Listener at localhost/38665] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:40,760 WARN [Listener at localhost/38665] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:40,762 INFO [Listener at localhost/38665] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:40,776 INFO [Listener at localhost/38665] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/java.io.tmpdir/Jetty_localhost_36795_datanode____f422wn/webapp 2023-02-11 15:03:40,849 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc84b712c056232f2: Processing first storage report for DS-022c3140-b1ad-4f45-aba2-58e24ba26d81 from datanode f2996ad2-b3cf-470e-abc4-49d2333c2224 2023-02-11 15:03:40,849 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc84b712c056232f2: from storage DS-022c3140-b1ad-4f45-aba2-58e24ba26d81 node DatanodeRegistration(127.0.0.1:34969, datanodeUuid=f2996ad2-b3cf-470e-abc4-49d2333c2224, infoPort=35957, infoSecurePort=0, ipcPort=38665, storageInfo=lv=-57;cid=testClusterID;nsid=324952689;c=1676127820352), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:40,849 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc84b712c056232f2: Processing first storage report for DS-1b130f85-4cfd-4bbd-9c88-ad0ae7b22e84 from datanode f2996ad2-b3cf-470e-abc4-49d2333c2224 2023-02-11 15:03:40,849 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc84b712c056232f2: from storage DS-1b130f85-4cfd-4bbd-9c88-ad0ae7b22e84 node DatanodeRegistration(127.0.0.1:34969, datanodeUuid=f2996ad2-b3cf-470e-abc4-49d2333c2224, infoPort=35957, infoSecurePort=0, ipcPort=38665, storageInfo=lv=-57;cid=testClusterID;nsid=324952689;c=1676127820352), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:40,904 INFO [Listener at localhost/38665] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36795 2023-02-11 15:03:40,916 WARN [Listener at localhost/43861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:41,035 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc1139cf7b7b24a20: Processing first storage report for DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e from datanode 2f3a6338-587c-4b5e-8b44-321a97e9a75b 2023-02-11 15:03:41,036 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc1139cf7b7b24a20: from storage DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e node DatanodeRegistration(127.0.0.1:40653, datanodeUuid=2f3a6338-587c-4b5e-8b44-321a97e9a75b, infoPort=38291, infoSecurePort=0, ipcPort=43861, storageInfo=lv=-57;cid=testClusterID;nsid=324952689;c=1676127820352), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-11 15:03:41,036 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc1139cf7b7b24a20: Processing first storage report for DS-ed622f72-4731-455c-bc44-53b51e48fa6e from datanode 2f3a6338-587c-4b5e-8b44-321a97e9a75b 2023-02-11 15:03:41,036 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc1139cf7b7b24a20: from storage DS-ed622f72-4731-455c-bc44-53b51e48fa6e node DatanodeRegistration(127.0.0.1:40653, datanodeUuid=2f3a6338-587c-4b5e-8b44-321a97e9a75b, infoPort=38291, infoSecurePort=0, ipcPort=43861, storageInfo=lv=-57;cid=testClusterID;nsid=324952689;c=1676127820352), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:41,130 DEBUG [Listener at localhost/43861] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a 2023-02-11 15:03:41,137 INFO [Listener at localhost/43861] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/zookeeper_0, clientPort=53525, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:03:41,138 INFO [Listener at localhost/43861] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53525 2023-02-11 15:03:41,138 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,139 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,154 INFO [Listener at localhost/43861] util.FSUtils(479): Created version file at hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a with version=8 2023-02-11 15:03:41,154 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,155 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,156 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44211/user/jenkins/test-data/08cec56e-73b3-e097-d157-bb91a4baa3d5/hbase-staging 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:41,158 INFO [Listener at localhost/43861] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:41,159 INFO [Listener at localhost/43861] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37067 2023-02-11 15:03:41,159 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,160 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,161 INFO [Listener at localhost/43861] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37067 connecting to ZooKeeper ensemble=127.0.0.1:53525 2023-02-11 15:03:41,171 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:370670x0, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:41,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37067-0x10043e8c7150000 connected 2023-02-11 15:03:41,186 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:41,186 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:41,187 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:41,187 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37067 2023-02-11 15:03:41,188 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37067 2023-02-11 15:03:41,188 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37067 2023-02-11 15:03:41,192 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37067 2023-02-11 15:03:41,192 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37067 2023-02-11 15:03:41,192 INFO [Listener at localhost/43861] master.HMaster(439): hbase.rootdir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a, hbase.cluster.distributed=false 2023-02-11 15:03:41,207 INFO [Listener at localhost/43861] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:41,207 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,207 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,207 INFO [Listener at localhost/43861] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:41,207 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,207 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:41,208 INFO [Listener at localhost/43861] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:41,209 INFO [Listener at localhost/43861] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43467 2023-02-11 15:03:41,209 INFO [Listener at localhost/43861] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:41,210 DEBUG [Listener at localhost/43861] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:41,210 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,212 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,212 INFO [Listener at localhost/43861] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43467 connecting to ZooKeeper ensemble=127.0.0.1:53525 2023-02-11 15:03:41,217 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:434670x0, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:41,217 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): regionserver:434670x0, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:41,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43467-0x10043e8c7150001 connected 2023-02-11 15:03:41,218 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:41,219 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:41,219 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43467 2023-02-11 15:03:41,220 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43467 2023-02-11 15:03:41,220 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43467 2023-02-11 15:03:41,220 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43467 2023-02-11 15:03:41,220 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43467 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:41,233 INFO [Listener at localhost/43861] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:41,234 INFO [Listener at localhost/43861] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42265 2023-02-11 15:03:41,234 INFO [Listener at localhost/43861] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:41,235 DEBUG [Listener at localhost/43861] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:41,235 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,236 INFO [Listener at localhost/43861] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,237 INFO [Listener at localhost/43861] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42265 connecting to ZooKeeper ensemble=127.0.0.1:53525 2023-02-11 15:03:41,239 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:422650x0, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:41,240 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): regionserver:422650x0, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:41,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42265-0x10043e8c7150002 connected 2023-02-11 15:03:41,241 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:41,241 DEBUG [Listener at localhost/43861] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:41,242 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42265 2023-02-11 15:03:41,242 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42265 2023-02-11 15:03:41,242 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42265 2023-02-11 15:03:41,243 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42265 2023-02-11 15:03:41,243 DEBUG [Listener at localhost/43861] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42265 2023-02-11 15:03:41,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,246 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:41,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,249 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:41,249 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:41,249 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:41,249 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:41,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:41,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37067,1676127821157 from backup master directory 2023-02-11 15:03:41,254 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,254 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:41,255 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:41,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/hbase.id with ID: 7a4ab5dc-2079-44be-b144-3ad7823a2aa6 2023-02-11 15:03:41,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:41,277 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x760dea07 to 127.0.0.1:53525 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:41,295 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b8a83c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:41,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:41,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:03:41,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:41,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store-tmp 2023-02-11 15:03:41,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:41,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:41,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:41,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:41,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:41,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:41,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:41,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127821303Disabling compacts and flushes for region at 1676127821303Disabling writes for close at 1676127821303Writing region close event to WAL at 1676127821303Closed at 1676127821303 2023-02-11 15:03:41,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/WALs/jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37067%2C1676127821157, suffix=, logDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/WALs/jenkins-hbase4.apache.org,37067,1676127821157, archiveDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/oldWALs, maxLogs=10 2023-02-11 15:03:41,320 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK] 2023-02-11 15:03:41,320 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK] 2023-02-11 15:03:41,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/WALs/jenkins-hbase4.apache.org,37067,1676127821157/jenkins-hbase4.apache.org%2C37067%2C1676127821157.1676127821306 2023-02-11 15:03:41,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK], DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK]] 2023-02-11 15:03:41,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:41,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:41,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:41,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:41,327 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:41,328 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:03:41,329 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:03:41,329 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:41,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:41,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:41,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:41,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73932892, jitterRate=0.10168594121932983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:41,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127821326Initializing all the Stores at 1676127821327 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127821327Cleaning up temporary data from old regions at 1676127821330 (+3 ms)Cleaning up detritus from prior splits at 1676127821331 (+1 ms)Region opened successfully at 1676127821334 (+3 ms) 2023-02-11 15:03:41,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:03:41,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:03:41,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:03:41,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:03:41,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 15:03:41,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 15:03:41,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:03:41,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:03:41,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:03:41,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:03:41,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:03:41,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:03:41,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:03:41,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:03:41,357 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:03:41,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:03:41,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:03:41,360 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:41,360 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:41,360 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,360 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:41,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37067,1676127821157, sessionid=0x10043e8c7150000, setting cluster-up flag (Was=false) 2023-02-11 15:03:41,365 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:03:41,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,375 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:03:41,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:41,379 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.hbase-snapshot/.tmp 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:41,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127851388 2023-02-11 15:03:41,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:03:41,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:03:41,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:03:41,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:03:41,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:03:41,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:03:41,389 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:41,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,389 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:03:41,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:03:41,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127821390,5,FailOnTimeoutGroup] 2023-02-11 15:03:41,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127821390,5,FailOnTimeoutGroup] 2023-02-11 15:03:41,390 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:03:41,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,398 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:41,399 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:41,399 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a 2023-02-11 15:03:41,405 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:41,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:41,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/info 2023-02-11 15:03:41,407 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:41,407 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,407 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:41,409 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:41,409 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:41,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:41,410 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/table 2023-02-11 15:03:41,411 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:41,411 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,411 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740 2023-02-11 15:03:41,412 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740 2023-02-11 15:03:41,413 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:41,414 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:41,416 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:41,416 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69129526, jitterRate=0.030110210180282593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:41,416 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127821405Initializing all the Stores at 1676127821405Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127821405Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127821405Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127821405Cleaning up temporary data from old regions at 1676127821413 (+8 ms)Cleaning up detritus from prior splits at 1676127821413Region opened successfully at 1676127821416 (+3 ms) 2023-02-11 15:03:41,416 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:41,417 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:41,417 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:41,417 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:41,417 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:41,417 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:41,417 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127821416Disabling compacts and flushes for region at 1676127821416Disabling writes for close at 1676127821417 (+1 ms)Writing region close event to WAL at 1676127821417Closed at 1676127821417 2023-02-11 15:03:41,418 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:41,418 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:03:41,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:03:41,419 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:03:41,420 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:03:41,445 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(952): ClusterId : 7a4ab5dc-2079-44be-b144-3ad7823a2aa6 2023-02-11 15:03:41,445 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(952): ClusterId : 7a4ab5dc-2079-44be-b144-3ad7823a2aa6 2023-02-11 15:03:41,445 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:41,445 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:41,449 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:41,449 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:41,449 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:41,449 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:41,451 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:41,452 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:41,452 DEBUG [RS:1;jenkins-hbase4:42265] zookeeper.ReadOnlyZKClient(139): Connect 0x742361fb to 127.0.0.1:53525 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:41,453 DEBUG [RS:0;jenkins-hbase4:43467] zookeeper.ReadOnlyZKClient(139): Connect 0x01eb30ca to 127.0.0.1:53525 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:41,465 DEBUG [RS:1;jenkins-hbase4:42265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ae4810f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:41,465 DEBUG [RS:1;jenkins-hbase4:42265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7edb0a8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:41,469 DEBUG [RS:0;jenkins-hbase4:43467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f2cce87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:41,469 DEBUG [RS:0;jenkins-hbase4:43467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b135bba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:41,475 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42265 2023-02-11 15:03:41,475 INFO [RS:1;jenkins-hbase4:42265] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:41,475 INFO [RS:1;jenkins-hbase4:42265] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:41,475 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:41,480 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37067,1676127821157 with isa=jenkins-hbase4.apache.org/172.31.14.131:42265, startcode=1676127821232 2023-02-11 15:03:41,480 DEBUG [RS:1;jenkins-hbase4:42265] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:41,480 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43467 2023-02-11 15:03:41,480 INFO [RS:0;jenkins-hbase4:43467] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:41,480 INFO [RS:0;jenkins-hbase4:43467] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:41,480 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:41,481 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37067,1676127821157 with isa=jenkins-hbase4.apache.org/172.31.14.131:43467, startcode=1676127821206 2023-02-11 15:03:41,481 DEBUG [RS:0;jenkins-hbase4:43467] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:41,482 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48333, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:41,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,484 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60057, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:41,484 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a 2023-02-11 15:03:41,485 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44211 2023-02-11 15:03:41,485 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:41,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,485 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a 2023-02-11 15:03:41,485 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44211 2023-02-11 15:03:41,485 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:41,486 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:41,489 DEBUG [RS:1;jenkins-hbase4:42265] zookeeper.ZKUtil(162): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,489 WARN [RS:1;jenkins-hbase4:42265] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:41,489 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43467,1676127821206] 2023-02-11 15:03:41,489 DEBUG [RS:0;jenkins-hbase4:43467] zookeeper.ZKUtil(162): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,489 WARN [RS:0;jenkins-hbase4:43467] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:41,489 INFO [RS:0;jenkins-hbase4:43467] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:41,489 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42265,1676127821232] 2023-02-11 15:03:41,489 INFO [RS:1;jenkins-hbase4:42265] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:41,489 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,489 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,496 DEBUG [RS:0;jenkins-hbase4:43467] zookeeper.ZKUtil(162): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,496 DEBUG [RS:1;jenkins-hbase4:42265] zookeeper.ZKUtil(162): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,496 DEBUG [RS:0;jenkins-hbase4:43467] zookeeper.ZKUtil(162): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,497 DEBUG [RS:1;jenkins-hbase4:42265] zookeeper.ZKUtil(162): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,498 DEBUG [RS:0;jenkins-hbase4:43467] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:41,498 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:41,498 INFO [RS:1;jenkins-hbase4:42265] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:41,498 INFO [RS:0;jenkins-hbase4:43467] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:41,499 INFO [RS:1;jenkins-hbase4:42265] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:41,500 INFO [RS:1;jenkins-hbase4:42265] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:41,500 INFO [RS:0;jenkins-hbase4:43467] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:41,500 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,504 INFO [RS:0;jenkins-hbase4:43467] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:41,504 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,504 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:41,505 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:41,506 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,506 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,506 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,506 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:41,507 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:41,507 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:0;jenkins-hbase4:43467] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,507 DEBUG [RS:1;jenkins-hbase4:42265] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:41,513 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,514 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,514 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,514 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,514 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,514 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,527 INFO [RS:1;jenkins-hbase4:42265] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:41,527 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42265,1676127821232-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,530 INFO [RS:0;jenkins-hbase4:43467] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:41,530 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43467,1676127821206-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,538 INFO [RS:1;jenkins-hbase4:42265] regionserver.Replication(203): jenkins-hbase4.apache.org,42265,1676127821232 started 2023-02-11 15:03:41,538 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42265,1676127821232, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42265, sessionid=0x10043e8c7150002 2023-02-11 15:03:41,538 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:41,538 DEBUG [RS:1;jenkins-hbase4:42265] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,538 DEBUG [RS:1;jenkins-hbase4:42265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42265,1676127821232' 2023-02-11 15:03:41,538 DEBUG [RS:1;jenkins-hbase4:42265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42265,1676127821232' 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:41,539 DEBUG [RS:1;jenkins-hbase4:42265] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:41,540 DEBUG [RS:1;jenkins-hbase4:42265] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:41,540 INFO [RS:1;jenkins-hbase4:42265] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:41,540 INFO [RS:1;jenkins-hbase4:42265] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:41,545 INFO [RS:0;jenkins-hbase4:43467] regionserver.Replication(203): jenkins-hbase4.apache.org,43467,1676127821206 started 2023-02-11 15:03:41,545 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43467,1676127821206, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43467, sessionid=0x10043e8c7150001 2023-02-11 15:03:41,545 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:41,545 DEBUG [RS:0;jenkins-hbase4:43467] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,545 DEBUG [RS:0;jenkins-hbase4:43467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43467,1676127821206' 2023-02-11 15:03:41,545 DEBUG [RS:0;jenkins-hbase4:43467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:41,545 DEBUG [RS:0;jenkins-hbase4:43467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43467,1676127821206' 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:41,546 DEBUG [RS:0;jenkins-hbase4:43467] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:41,546 INFO [RS:0;jenkins-hbase4:43467] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:41,546 INFO [RS:0;jenkins-hbase4:43467] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:41,571 DEBUG [jenkins-hbase4:37067] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:03:41,571 DEBUG [jenkins-hbase4:37067] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:41,572 DEBUG [jenkins-hbase4:37067] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:41,572 DEBUG [jenkins-hbase4:37067] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:41,572 DEBUG [jenkins-hbase4:37067] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:41,573 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42265,1676127821232, state=OPENING 2023-02-11 15:03:41,575 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:03:41,576 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:41,577 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:41,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42265,1676127821232}] 2023-02-11 15:03:41,731 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,732 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:41,733 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54032, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:41,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:03:41,738 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:41,739 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42265%2C1676127821232.meta, suffix=.meta, logDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,42265,1676127821232, archiveDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/oldWALs, maxLogs=32 2023-02-11 15:03:41,755 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK] 2023-02-11 15:03:41,755 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK] 2023-02-11 15:03:41,757 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,42265,1676127821232/jenkins-hbase4.apache.org%2C42265%2C1676127821232.meta.1676127821739.meta 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK], DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK]] 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:03:41,757 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:03:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:03:41,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:41,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/info 2023-02-11 15:03:41,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/info 2023-02-11 15:03:41,761 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:41,761 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,761 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:41,762 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:41,762 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:41,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:41,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:41,764 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/table 2023-02-11 15:03:41,764 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/table 2023-02-11 15:03:41,764 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:41,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:41,765 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740 2023-02-11 15:03:41,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740 2023-02-11 15:03:41,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:41,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:41,769 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68176535, jitterRate=0.01590953767299652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:41,769 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127821758Writing region info on filesystem at 1676127821758Initializing all the Stores at 1676127821758Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127821758Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127821760 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127821760Cleaning up temporary data from old regions at 1676127821767 (+7 ms)Cleaning up detritus from prior splits at 1676127821767Running coprocessor post-open hooks at 1676127821769 (+2 ms)Region opened successfully at 1676127821769 2023-02-11 15:03:41,769 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127821731 2023-02-11 15:03:41,773 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:03:41,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:03:41,774 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42265,1676127821232, state=OPEN 2023-02-11 15:03:41,775 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:03:41,775 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:41,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:03:41,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42265,1676127821232 in 198 msec 2023-02-11 15:03:41,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:03:41,778 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-11 15:03:41,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-11 15:03:41,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127821246, completionTime=-1 2023-02-11 15:03:41,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:03:41,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:03:41,781 DEBUG [hconnection-0xae3130d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:41,782 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54034, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:41,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:03:41,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127881784 2023-02-11 15:03:41,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127941784 2023-02-11 15:03:41,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-11 15:03:41,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37067,1676127821157-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37067,1676127821157-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37067,1676127821157-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37067, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:03:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:41,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:03:41,796 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:41,797 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:03:41,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:41,798 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:41,799 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe empty. 2023-02-11 15:03:41,799 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:41,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:03:41,807 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:41,808 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 83a8d5169f9c4d91fc71c76edcac80fe, NAME => 'hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp 2023-02-11 15:03:41,814 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:41,814 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 83a8d5169f9c4d91fc71c76edcac80fe, disabling compactions & flushes 2023-02-11 15:03:41,814 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:41,814 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:41,814 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. after waiting 0 ms 2023-02-11 15:03:41,814 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:41,814 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:41,814 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 83a8d5169f9c4d91fc71c76edcac80fe: Waiting for close lock at 1676127821814Disabling compacts and flushes for region at 1676127821814Disabling writes for close at 1676127821814Writing region close event to WAL at 1676127821814Closed at 1676127821814 2023-02-11 15:03:41,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:41,817 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127821817"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127821817"}]},"ts":"1676127821817"} 2023-02-11 15:03:41,818 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:41,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:41,819 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127821819"}]},"ts":"1676127821819"} 2023-02-11 15:03:41,820 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:41,822 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:41,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:41,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:41,823 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:41,823 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=83a8d5169f9c4d91fc71c76edcac80fe, ASSIGN}] 2023-02-11 15:03:41,825 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=83a8d5169f9c4d91fc71c76edcac80fe, ASSIGN 2023-02-11 15:03:41,826 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=83a8d5169f9c4d91fc71c76edcac80fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42265,1676127821232; forceNewPlan=false, retain=false 2023-02-11 15:03:41,976 INFO [jenkins-hbase4:37067] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:41,976 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=83a8d5169f9c4d91fc71c76edcac80fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:41,977 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127821976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127821976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127821976"}]},"ts":"1676127821976"} 2023-02-11 15:03:41,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 83a8d5169f9c4d91fc71c76edcac80fe, server=jenkins-hbase4.apache.org,42265,1676127821232}] 2023-02-11 15:03:42,148 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:42,149 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42265%2C1676127821232, suffix=, logDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,42265,1676127821232, archiveDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/oldWALs, maxLogs=32 2023-02-11 15:03:42,165 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK] 2023-02-11 15:03:42,165 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK] 2023-02-11 15:03:42,168 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,42265,1676127821232/jenkins-hbase4.apache.org%2C42265%2C1676127821232.1676127822150 2023-02-11 15:03:42,168 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK], DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK]] 2023-02-11 15:03:42,168 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 83a8d5169f9c4d91fc71c76edcac80fe, NAME => 'hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:42,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:42,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,170 INFO [StoreOpener-83a8d5169f9c4d91fc71c76edcac80fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,171 DEBUG [StoreOpener-83a8d5169f9c4d91fc71c76edcac80fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/info 2023-02-11 15:03:42,171 DEBUG [StoreOpener-83a8d5169f9c4d91fc71c76edcac80fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/info 2023-02-11 15:03:42,171 INFO [StoreOpener-83a8d5169f9c4d91fc71c76edcac80fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83a8d5169f9c4d91fc71c76edcac80fe columnFamilyName info 2023-02-11 15:03:42,172 INFO [StoreOpener-83a8d5169f9c4d91fc71c76edcac80fe-1] regionserver.HStore(310): Store=83a8d5169f9c4d91fc71c76edcac80fe/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:42,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:42,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:42,178 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 83a8d5169f9c4d91fc71c76edcac80fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69852670, jitterRate=0.04088589549064636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:42,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 83a8d5169f9c4d91fc71c76edcac80fe: Running coprocessor pre-open hook at 1676127822169Writing region info on filesystem at 1676127822169Initializing all the Stores at 1676127822170 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127822170Cleaning up temporary data from old regions at 1676127822174 (+4 ms)Cleaning up detritus from prior splits at 1676127822174Running coprocessor post-open hooks at 1676127822178 (+4 ms)Region opened successfully at 1676127822178 2023-02-11 15:03:42,180 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe., pid=6, masterSystemTime=1676127822130 2023-02-11 15:03:42,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:42,182 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:42,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=83a8d5169f9c4d91fc71c76edcac80fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:42,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127822182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127822182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127822182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127822182"}]},"ts":"1676127822182"} 2023-02-11 15:03:42,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:42,185 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 83a8d5169f9c4d91fc71c76edcac80fe, server=jenkins-hbase4.apache.org,42265,1676127821232 in 206 msec 2023-02-11 15:03:42,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:42,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=83a8d5169f9c4d91fc71c76edcac80fe, ASSIGN in 362 msec 2023-02-11 15:03:42,187 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:42,187 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127822187"}]},"ts":"1676127822187"} 2023-02-11 15:03:42,189 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:42,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:42,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 397 msec 2023-02-11 15:03:42,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:42,198 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:42,198 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:42,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:42,208 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:42,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-11 15:03:42,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:42,219 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:42,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-11 15:03:42,226 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:42,229 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:42,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.974sec 2023-02-11 15:03:42,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:42,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:42,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:42,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37067,1676127821157-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:42,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37067,1676127821157-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:42,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:42,245 DEBUG [Listener at localhost/43861] zookeeper.ReadOnlyZKClient(139): Connect 0x5b343a4c to 127.0.0.1:53525 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:42,248 DEBUG [Listener at localhost/43861] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@478466da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:42,250 DEBUG [hconnection-0x7e634876-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:42,251 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54036, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:42,252 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:42,252 DEBUG [Listener at localhost/43861] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:42,255 DEBUG [Listener at localhost/43861] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:42,256 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46770, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:42,257 INFO [Listener at localhost/43861] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:42,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:42,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:42,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:46770 deadline: 1676127882257, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:42,258 INFO [Listener at localhost/43861] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 15:03:42,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:42,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:42,262 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:42,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-11 15:03:42,263 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:42,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:42,264 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,265 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 empty. 2023-02-11 15:03:42,265 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,265 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-11 15:03:42,274 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:42,275 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b13d4393934fad7d3808e014a553215, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp 2023-02-11 15:03:42,282 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:42,282 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 2b13d4393934fad7d3808e014a553215, disabling compactions & flushes 2023-02-11 15:03:42,282 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,282 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,282 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. after waiting 0 ms 2023-02-11 15:03:42,282 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,282 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,283 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 2b13d4393934fad7d3808e014a553215: Waiting for close lock at 1676127822282Disabling compacts and flushes for region at 1676127822282Disabling writes for close at 1676127822282Writing region close event to WAL at 1676127822282Closed at 1676127822282 2023-02-11 15:03:42,285 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:42,286 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676127822285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127822285"}]},"ts":"1676127822285"} 2023-02-11 15:03:42,287 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:42,287 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:42,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127822287"}]},"ts":"1676127822287"} 2023-02-11 15:03:42,288 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-11 15:03:42,291 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:42,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:42,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:42,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:42,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, ASSIGN}] 2023-02-11 15:03:42,296 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, ASSIGN 2023-02-11 15:03:42,297 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42265,1676127821232; forceNewPlan=false, retain=false 2023-02-11 15:03:42,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:42,447 INFO [jenkins-hbase4:37067] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:42,447 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2b13d4393934fad7d3808e014a553215, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:42,447 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676127822447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127822447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127822447"}]},"ts":"1676127822447"} 2023-02-11 15:03:42,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2b13d4393934fad7d3808e014a553215, server=jenkins-hbase4.apache.org,42265,1676127821232}] 2023-02-11 15:03:42,548 INFO [RS:0;jenkins-hbase4:43467] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43467%2C1676127821206, suffix=, logDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,43467,1676127821206, archiveDir=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/oldWALs, maxLogs=32 2023-02-11 15:03:42,567 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK] 2023-02-11 15:03:42,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:42,567 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK] 2023-02-11 15:03:42,569 INFO [RS:0;jenkins-hbase4:43467] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/WALs/jenkins-hbase4.apache.org,43467,1676127821206/jenkins-hbase4.apache.org%2C43467%2C1676127821206.1676127822548 2023-02-11 15:03:42,569 DEBUG [RS:0;jenkins-hbase4:43467] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34969,DS-022c3140-b1ad-4f45-aba2-58e24ba26d81,DISK], DatanodeInfoWithStorage[127.0.0.1:40653,DS-a01c465d-6a2a-4470-bddf-b0bfa3112c4e,DISK]] 2023-02-11 15:03:42,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2b13d4393934fad7d3808e014a553215, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:42,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:42,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,604 INFO [StoreOpener-2b13d4393934fad7d3808e014a553215-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,606 DEBUG [StoreOpener-2b13d4393934fad7d3808e014a553215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1 2023-02-11 15:03:42,606 DEBUG [StoreOpener-2b13d4393934fad7d3808e014a553215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1 2023-02-11 15:03:42,606 INFO [StoreOpener-2b13d4393934fad7d3808e014a553215-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b13d4393934fad7d3808e014a553215 columnFamilyName f1 2023-02-11 15:03:42,606 INFO [StoreOpener-2b13d4393934fad7d3808e014a553215-1] regionserver.HStore(310): Store=2b13d4393934fad7d3808e014a553215/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:42,607 INFO [StoreOpener-2b13d4393934fad7d3808e014a553215-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,608 DEBUG [StoreOpener-2b13d4393934fad7d3808e014a553215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2 2023-02-11 15:03:42,608 DEBUG [StoreOpener-2b13d4393934fad7d3808e014a553215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2 2023-02-11 15:03:42,608 INFO [StoreOpener-2b13d4393934fad7d3808e014a553215-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b13d4393934fad7d3808e014a553215 columnFamilyName f2 2023-02-11 15:03:42,608 INFO [StoreOpener-2b13d4393934fad7d3808e014a553215-1] regionserver.HStore(310): Store=2b13d4393934fad7d3808e014a553215/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:42,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:42,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:42,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:42,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2b13d4393934fad7d3808e014a553215; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68929308, jitterRate=0.027126729488372803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:42,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2b13d4393934fad7d3808e014a553215: Running coprocessor pre-open hook at 1676127822603Writing region info on filesystem at 1676127822603Initializing all the Stores at 1676127822604 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127822604Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127822604Cleaning up temporary data from old regions at 1676127822610 (+6 ms)Cleaning up detritus from prior splits at 1676127822610Running coprocessor post-open hooks at 1676127822613 (+3 ms)Region opened successfully at 1676127822613 2023-02-11 15:03:42,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215., pid=12, masterSystemTime=1676127822600 2023-02-11 15:03:42,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:42,615 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2b13d4393934fad7d3808e014a553215, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:42,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676127822615"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127822615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127822615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127822615"}]},"ts":"1676127822615"} 2023-02-11 15:03:42,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 15:03:42,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2b13d4393934fad7d3808e014a553215, server=jenkins-hbase4.apache.org,42265,1676127821232 in 168 msec 2023-02-11 15:03:42,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 15:03:42,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, ASSIGN in 326 msec 2023-02-11 15:03:42,620 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:42,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127822620"}]},"ts":"1676127822620"} 2023-02-11 15:03:42,621 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-11 15:03:42,624 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:42,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 364 msec 2023-02-11 15:03:42,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:42,869 INFO [Listener at localhost/43861] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-11 15:03:42,869 DEBUG [Listener at localhost/43861] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-11 15:03:42,869 INFO [Listener at localhost/43861] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:42,871 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-11 15:03:42,871 INFO [Listener at localhost/43861] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:42,872 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-11 15:03:42,872 INFO [Listener at localhost/43861] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:42,957 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,058 INFO [Listener at localhost/43861] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:43,058 INFO [Listener at localhost/43861] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:43,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 15:03:43,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127823059 (current time:1676127823059). 2023-02-11 15:03:43,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:43,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] zookeeper.ReadOnlyZKClient(139): Connect 0x5c7e490c to 127.0.0.1:53525 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:43,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@281cadd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:43,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:43,064 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54042, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:43,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c7e490c to 127.0.0.1:53525 2023-02-11 15:03:43,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:43,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:43,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 15:03:43,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 15:03:43,069 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 15:03:43,070 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676128423070 2023-02-11 15:03:43,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-11 15:03:43,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,071 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:43,071 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-11 15:03:43,071 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:43,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 15:03:43,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 4 msec 2023-02-11 15:03:43,073 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 15:03:43,074 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676128423074 2023-02-11 15:03:43,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-11 15:03:43,082 INFO [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-11 15:03:43,082 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:43,083 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-11 15:03:43,083 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-11 15:03:43,084 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,084 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,085 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:43,085 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:43,085 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:43,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:43,086 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,086 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-11 15:03:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-11 15:03:43,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 15:03:43,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-11 15:03:43,087 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 15:03:43,087 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:43,087 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-11 15:03:43,088 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 15:03:43,088 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 15:03:43,088 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:43,088 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42265,1676127821232' joining acquired barrier for procedure (foo) in zk 2023-02-11 15:03:43,089 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-11 15:03:43,089 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-11 15:03:43,089 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43467,1676127821206' joining acquired barrier for procedure (foo) in zk 2023-02-11 15:03:43,092 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,092 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,092 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:43,092 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,092 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,092 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:43,092 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:43,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:43,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:43,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42265,1676127821232' joining acquired barrier for procedure 'foo' on coordinator 2023-02-11 15:03:43,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43216c6d[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:43,094 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-11 15:03:43,094 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 15:03:43,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,095 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,095 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:43,095 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 15:03:43,095 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,095 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-11 15:03:43,095 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 15:03:43,095 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. started... 2023-02-11 15:03:43,095 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:43,095 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43467,1676127821206' in zk 2023-02-11 15:03:43,095 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2b13d4393934fad7d3808e014a553215 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 15:03:43,097 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 15:03:43,097 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:43,097 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 15:03:43,110 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f1/adcd20592e5a4965ad41a6a24babcdc0 2023-02-11 15:03:43,127 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f2/b678778f59244cc49d0687c3273125bc 2023-02-11 15:03:43,131 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f1/adcd20592e5a4965ad41a6a24babcdc0 as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0 2023-02-11 15:03:43,135 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:43,136 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f2/b678778f59244cc49d0687c3273125bc as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc 2023-02-11 15:03:43,139 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:43,140 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2b13d4393934fad7d3808e014a553215 in 45ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:43,141 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 15:03:43,141 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2b13d4393934fad7d3808e014a553215: 2023-02-11 15:03:43,141 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.' region-info for snapshot=foo 2023-02-11 15:03:43,141 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:43,141 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0] hfiles 2023-02-11 15:03:43,141 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0 for snapshot=foo 2023-02-11 15:03:43,142 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc] hfiles 2023-02-11 15:03:43,142 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc for snapshot=foo 2023-02-11 15:03:43,150 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. completed. 2023-02-11 15:03:43,150 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,150 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 15:03:43,151 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 15:03:43,151 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,151 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-11 15:03:43,151 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42265,1676127821232' in zk 2023-02-11 15:03:43,152 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,152 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-11 15:03:43,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,152 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:43,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:43,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:43,152 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-11 15:03:43,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:43,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:43,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:43,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:43,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:43,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42265,1676127821232': 2023-02-11 15:03:43,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42265,1676127821232' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-11 15:03:43,155 INFO [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-11 15:03:43,156 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:43,156 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:43,156 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-11 15:03:43,156 INFO [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:43,158 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:43,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:43,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:43,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:43,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:43,159 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:43,159 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:43,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:43,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,160 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,161 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:43,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-11 15:03:43,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,165 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,165 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,165 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,165 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-11 15:03:43,165 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:43,165 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:43,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/foo because node does not exist (not an error) 2023-02-11 15:03:43,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-11 15:03:43,166 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-11 15:03:43,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:43,166 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-11 15:03:43,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.hbase-snapshot/.tmp/foo 2023-02-11 15:03:43,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:43,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:43,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:43,171 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:43,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-11 15:03:43,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:43,173 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:43,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.hbase-snapshot/.tmp/foo to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.hbase-snapshot/foo 2023-02-11 15:03:43,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-11 15:03:43,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.hbase-snapshot/.tmp/foo 2023-02-11 15:03:43,199 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.hbase-snapshot/.tmp/foo 2023-02-11 15:03:43,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676127823070Consolidate snapshot: foo at 1676127823166 (+96 ms)Loading Region manifests for foo at 1676127823166Writing data manifest for foo at 1676127823170 (+4 ms)Verifying snapshot: foo at 1676127823178 (+8 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676127823199 (+21 ms) 2023-02-11 15:03:43,201 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-11 15:03:43,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 130 msec 2023-02-11 15:03:43,373 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-11 15:03:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:43,375 INFO [Listener at localhost/43861] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:43,378 INFO [Listener at localhost/43861] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:43,382 INFO [Listener at localhost/43861] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:43,409 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,491 INFO [Listener at localhost/43861] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:43,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:43,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,498 INFO [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 15:03:43,498 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:43,499 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-11 15:03:43,499 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-11 15:03:43,500 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,500 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,501 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:43,501 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:43,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:43,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:43,501 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,501 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,502 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-11 15:03:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-11 15:03:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:43,503 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:43,504 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-11 15:03:43,504 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-11 15:03:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-11 15:03:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43467,1676127821206' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-11 15:03:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 15:03:43,505 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:43,505 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,505 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. started... 2023-02-11 15:03:43,505 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2b13d4393934fad7d3808e014a553215 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 15:03:43,506 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,506 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,506 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:43,532 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f1/9cc6a11ab8594dceafb4d775807fa84e 2023-02-11 15:03:43,554 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f2/762339e276cb4a16b2ac53679f8cc6e7 2023-02-11 15:03:43,559 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f1/9cc6a11ab8594dceafb4d775807fa84e as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/9cc6a11ab8594dceafb4d775807fa84e 2023-02-11 15:03:43,565 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/9cc6a11ab8594dceafb4d775807fa84e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:43,567 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/.tmp/f2/762339e276cb4a16b2ac53679f8cc6e7 as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/762339e276cb4a16b2ac53679f8cc6e7 2023-02-11 15:03:43,571 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/762339e276cb4a16b2ac53679f8cc6e7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:43,572 INFO [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2b13d4393934fad7d3808e014a553215 in 67ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:43,573 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2b13d4393934fad7d3808e014a553215: 2023-02-11 15:03:43,573 DEBUG [rs(jenkins-hbase4.apache.org,42265,1676127821232)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,573 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 15:03:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 15:03:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-11 15:03:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42265,1676127821232' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-11 15:03:43,575 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,575 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:43,575 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,575 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:43,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42265,1676127821232' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-11 15:03:43,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@471ee0d1[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:43,577 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-11 15:03:43,577 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-11 15:03:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-11 15:03:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-11 15:03:43,580 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,580 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-11 15:03:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,43467,1676127821206' in zk 2023-02-11 15:03:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,42265,1676127821232' in zk 2023-02-11 15:03:43,582 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-11 15:03:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,42265,1676127821232' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-11 15:03:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-11 15:03:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:43,582 DEBUG [member: 'jenkins-hbase4.apache.org,43467,1676127821206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-11 15:03:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,42265,1676127821232': 2023-02-11 15:03:43,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42265,1676127821232' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-11 15:03:43,585 INFO [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-11 15:03:43,585 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:43,585 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:43,585 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,585 INFO [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:43,587 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:43,587 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:43,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:43,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:43,587 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:43,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,588 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,589 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,590 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:43,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-11 15:03:43,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:43,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:43,593 DEBUG [(jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,594 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks because node does not exist (not an error) 2023-02-11 15:03:43,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:43,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:43,593 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:43,594 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:43,694 DEBUG [Listener at localhost/43861] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:43,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:43,699 INFO [Listener at localhost/43861] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676127823059 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:43,699 DEBUG [Listener at localhost/43861] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44211/user/jenkins/test-data/08cec56e-73b3-e097-d157-bb91a4baa3d5/foo/8c1d15d1-c6ce-40b8-9093-225c375ed480/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,700 INFO [Listener at localhost/43861] snapshot.RestoreSnapshotHelper(239): region to add: 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:43,700 INFO [Listener at localhost/43861] snapshot.RestoreSnapshotHelper(585): clone region=2b13d4393934fad7d3808e014a553215 as 2b13d4393934fad7d3808e014a553215 in snapshot foo 2023-02-11 15:03:43,700 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2b13d4393934fad7d3808e014a553215, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44211/user/jenkins/test-data/08cec56e-73b3-e097-d157-bb91a4baa3d5/foo/8c1d15d1-c6ce-40b8-9093-225c375ed480 2023-02-11 15:03:43,706 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:43,706 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink adcd20592e5a4965ad41a6a24babcdc0 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,708 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b678778f59244cc49d0687c3273125bc from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,709 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2b13d4393934fad7d3808e014a553215, disabling compactions & flushes 2023-02-11 15:03:43,709 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,709 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,709 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. after waiting 0 ms 2023-02-11 15:03:43,709 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,709 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,709 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2b13d4393934fad7d3808e014a553215: Waiting for close lock at 1676127823709Disabling compacts and flushes for region at 1676127823709Disabling writes for close at 1676127823709Writing region close event to WAL at 1676127823709Closed at 1676127823709 2023-02-11 15:03:43,711 INFO [Listener at localhost/43861] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676127823059 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:43,711 DEBUG [Listener at localhost/43861] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44211/user/jenkins/test-data/08cec56e-73b3-e097-d157-bb91a4baa3d5/foo/8c1d15d1-c6ce-40b8-9093-225c375ed480 2023-02-11 15:03:43,711 DEBUG [Listener at localhost/43861] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44211/user/jenkins/test-data/08cec56e-73b3-e097-d157-bb91a4baa3d5/foo/8c1d15d1-c6ce-40b8-9093-225c375ed480 2023-02-11 15:03:43,712 DEBUG [Listener at localhost/43861] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:43,712 DEBUG [Listener at localhost/43861] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:43,712 DEBUG [Listener at localhost/43861] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-11 15:03:43,713 DEBUG [Listener at localhost/43861] util.CommonFSUtils(699): |----------2b13d4393934fad7d3808e014a553215/ 2023-02-11 15:03:43,713 DEBUG [Listener at localhost/43861] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:43,713 DEBUG [Listener at localhost/43861] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:43,713 DEBUG [Listener at localhost/43861] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=2b13d4393934fad7d3808e014a553215-adcd20592e5a4965ad41a6a24babcdc0 2023-02-11 15:03:43,713 DEBUG [Listener at localhost/43861] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:43,714 DEBUG [Listener at localhost/43861] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=2b13d4393934fad7d3808e014a553215-b678778f59244cc49d0687c3273125bc hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/9cc6a11ab8594dceafb4d775807fa84e hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0 hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/762339e276cb4a16b2ac53679f8cc6e7 hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc 2023-02-11 15:03:43,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-11 15:03:43,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-11 15:03:43,722 INFO [Listener at localhost/43861] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:43,726 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127823726"}]},"ts":"1676127823726"} 2023-02-11 15:03:43,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:43,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-11 15:03:43,731 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-11 15:03:43,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, UNASSIGN}] 2023-02-11 15:03:43,733 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, UNASSIGN 2023-02-11 15:03:43,733 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2b13d4393934fad7d3808e014a553215, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:43,733 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676127823733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127823733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127823733"}]},"ts":"1676127823733"} 2023-02-11 15:03:43,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2b13d4393934fad7d3808e014a553215, server=jenkins-hbase4.apache.org,42265,1676127821232}] 2023-02-11 15:03:43,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:43,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:43,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2b13d4393934fad7d3808e014a553215, disabling compactions & flushes 2023-02-11 15:03:43,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. after waiting 0 ms 2023-02-11 15:03:43,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:43,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215. 2023-02-11 15:03:43,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2b13d4393934fad7d3808e014a553215: Waiting for close lock at 1676127823886Running coprocessor pre-close hooks at 1676127823886Disabling compacts and flushes for region at 1676127823886Disabling writes for close at 1676127823887 (+1 ms)Writing region close event to WAL at 1676127823887Running coprocessor post-close hooks at 1676127823890 (+3 ms)Closed at 1676127823890 2023-02-11 15:03:43,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:43,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2b13d4393934fad7d3808e014a553215, regionState=CLOSED 2023-02-11 15:03:43,892 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676127823892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127823892"}]},"ts":"1676127823892"} 2023-02-11 15:03:43,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 15:03:43,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2b13d4393934fad7d3808e014a553215, server=jenkins-hbase4.apache.org,42265,1676127821232 in 159 msec 2023-02-11 15:03:43,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 15:03:43,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=2b13d4393934fad7d3808e014a553215, UNASSIGN in 162 msec 2023-02-11 15:03:43,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127823896"}]},"ts":"1676127823896"} 2023-02-11 15:03:43,897 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-11 15:03:43,898 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-11 15:03:43,900 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-11 15:03:44,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:44,029 INFO [Listener at localhost/43861] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-11 15:03:44,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,032 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:44,038 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:44,040 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1, FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2, FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/recovered.edits] 2023-02-11 15:03:44,043 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/9cc6a11ab8594dceafb4d775807fa84e to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/9cc6a11ab8594dceafb4d775807fa84e 2023-02-11 15:03:44,044 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0 to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f1/adcd20592e5a4965ad41a6a24babcdc0 2023-02-11 15:03:44,046 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/762339e276cb4a16b2ac53679f8cc6e7 to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/762339e276cb4a16b2ac53679f8cc6e7 2023-02-11 15:03:44,047 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/f2/b678778f59244cc49d0687c3273125bc 2023-02-11 15:03:44,049 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/recovered.edits/12.seqid to hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215/recovered.edits/12.seqid 2023-02-11 15:03:44,050 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/2b13d4393934fad7d3808e014a553215 2023-02-11 15:03:44,050 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-11 15:03:44,051 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,053 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-11 15:03:44,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-11 15:03:44,057 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,057 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-11 15:03:44,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127824058"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:44,059 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 15:03:44,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2b13d4393934fad7d3808e014a553215, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676127822260.2b13d4393934fad7d3808e014a553215.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 15:03:44,059 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-11 15:03:44,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676127824059"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:44,060 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-11 15:03:44,062 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-11 15:03:44,063 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-11 15:03:44,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37067] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:44,135 INFO [Listener at localhost/43861] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-11 15:03:44,135 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:44,135 INFO [Listener at localhost/43861] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:44,135 DEBUG [Listener at localhost/43861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b343a4c to 127.0.0.1:53525 2023-02-11 15:03:44,135 DEBUG [Listener at localhost/43861] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,135 DEBUG [Listener at localhost/43861] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:44,135 DEBUG [Listener at localhost/43861] util.JVMClusterUtil(257): Found active master hash=1335166144, stopped=false 2023-02-11 15:03:44,136 INFO [Listener at localhost/43861] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:44,138 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:44,138 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:44,138 INFO [Listener at localhost/43861] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:44,138 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:44,138 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:44,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:44,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:44,140 DEBUG [Listener at localhost/43861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x760dea07 to 127.0.0.1:53525 2023-02-11 15:03:44,140 DEBUG [Listener at localhost/43861] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:44,140 INFO [Listener at localhost/43861] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43467,1676127821206' ***** 2023-02-11 15:03:44,140 INFO [Listener at localhost/43861] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:44,140 INFO [Listener at localhost/43861] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42265,1676127821232' ***** 2023-02-11 15:03:44,140 INFO [Listener at localhost/43861] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:44,140 INFO [RS:0;jenkins-hbase4:43467] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:44,140 INFO [RS:0;jenkins-hbase4:43467] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:44,140 INFO [RS:1;jenkins-hbase4:42265] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:44,140 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:44,141 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:44,141 INFO [RS:1;jenkins-hbase4:42265] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:44,141 INFO [RS:0;jenkins-hbase4:43467] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:44,142 INFO [RS:1;jenkins-hbase4:42265] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:44,142 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(3304): Received CLOSE for 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:44,143 DEBUG [RS:0;jenkins-hbase4:43467] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01eb30ca to 127.0.0.1:53525 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:44,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 83a8d5169f9c4d91fc71c76edcac80fe, disabling compactions & flushes 2023-02-11 15:03:44,143 DEBUG [RS:0;jenkins-hbase4:43467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:44,143 DEBUG [RS:1;jenkins-hbase4:42265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x742361fb to 127.0.0.1:53525 2023-02-11 15:03:44,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:44,143 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43467,1676127821206; all regions closed. 2023-02-11 15:03:44,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. after waiting 0 ms 2023-02-11 15:03:44,143 DEBUG [RS:1;jenkins-hbase4:42265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:44,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 83a8d5169f9c4d91fc71c76edcac80fe 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:44,143 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-11 15:03:44,143 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1479): Online Regions={83a8d5169f9c4d91fc71c76edcac80fe=hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe., 1588230740=hbase:meta,,1.1588230740} 2023-02-11 15:03:44,144 DEBUG [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1505): Waiting on 1588230740, 83a8d5169f9c4d91fc71c76edcac80fe 2023-02-11 15:03:44,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:44,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:44,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:44,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:44,144 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:44,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-11 15:03:44,149 DEBUG [RS:0;jenkins-hbase4:43467] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/oldWALs 2023-02-11 15:03:44,149 INFO [RS:0;jenkins-hbase4:43467] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43467%2C1676127821206:(num 1676127822548) 2023-02-11 15:03:44,149 DEBUG [RS:0;jenkins-hbase4:43467] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,149 INFO [RS:0;jenkins-hbase4:43467] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:44,150 INFO [RS:0;jenkins-hbase4:43467] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:44,150 INFO [RS:0;jenkins-hbase4:43467] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:44,150 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:44,150 INFO [RS:0;jenkins-hbase4:43467] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:44,150 INFO [RS:0;jenkins-hbase4:43467] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:44,151 INFO [RS:0;jenkins-hbase4:43467] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43467 2023-02-11 15:03:44,154 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:44,154 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:44,154 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43467,1676127821206 2023-02-11 15:03:44,154 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:44,154 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2dc411de rejected from java.util.concurrent.ThreadPoolExecutor@29fb80be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,154 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:44,154 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5098c02f rejected from java.util.concurrent.ThreadPoolExecutor@29fb80be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,157 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43467,1676127821206] 2023-02-11 15:03:44,157 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43467,1676127821206; numProcessing=1 2023-02-11 15:03:44,158 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43467,1676127821206 already deleted, retry=false 2023-02-11 15:03:44,158 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43467,1676127821206 expired; onlineServers=1 2023-02-11 15:03:44,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/.tmp/info/e9d6ff66e2f04bd39be087bc5458e0b1 2023-02-11 15:03:44,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/.tmp/info/3fe6d272968748e4aea06a719d8e8ec5 2023-02-11 15:03:44,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9d6ff66e2f04bd39be087bc5458e0b1 2023-02-11 15:03:44,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/.tmp/info/3fe6d272968748e4aea06a719d8e8ec5 as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/info/3fe6d272968748e4aea06a719d8e8ec5 2023-02-11 15:03:44,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/info/3fe6d272968748e4aea06a719d8e8ec5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:44,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 83a8d5169f9c4d91fc71c76edcac80fe in 37ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:44,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-11 15:03:44,187 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/.tmp/rep_barrier/22ef55da949a4f198b6a642dd7a930c3 2023-02-11 15:03:44,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/namespace/83a8d5169f9c4d91fc71c76edcac80fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:44,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:44,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 83a8d5169f9c4d91fc71c76edcac80fe: Waiting for close lock at 1676127824143Running coprocessor pre-close hooks at 1676127824143Disabling compacts and flushes for region at 1676127824143Disabling writes for close at 1676127824143Obtaining lock to block concurrent updates at 1676127824143Preparing flush snapshotting stores in 83a8d5169f9c4d91fc71c76edcac80fe at 1676127824143Finished memstore snapshotting hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127824143Flushing stores of hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. at 1676127824144 (+1 ms)Flushing 83a8d5169f9c4d91fc71c76edcac80fe/info: creating writer at 1676127824144Flushing 83a8d5169f9c4d91fc71c76edcac80fe/info: appending metadata at 1676127824148 (+4 ms)Flushing 83a8d5169f9c4d91fc71c76edcac80fe/info: closing flushed file at 1676127824148Flushing 83a8d5169f9c4d91fc71c76edcac80fe/info: reopening flushed file at 1676127824175 (+27 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 83a8d5169f9c4d91fc71c76edcac80fe in 37ms, sequenceid=6, compaction requested=false at 1676127824180 (+5 ms)Writing region close event to WAL at 1676127824185 (+5 ms)Running coprocessor post-close hooks at 1676127824189 (+4 ms)Closed at 1676127824189 2023-02-11 15:03:44,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127821794.83a8d5169f9c4d91fc71c76edcac80fe. 2023-02-11 15:03:44,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22ef55da949a4f198b6a642dd7a930c3 2023-02-11 15:03:44,200 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/.tmp/table/bb2891c377994d1db73aaeca0e83a110 2023-02-11 15:03:44,203 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb2891c377994d1db73aaeca0e83a110 2023-02-11 15:03:44,204 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/.tmp/info/e9d6ff66e2f04bd39be087bc5458e0b1 as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/info/e9d6ff66e2f04bd39be087bc5458e0b1 2023-02-11 15:03:44,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9d6ff66e2f04bd39be087bc5458e0b1 2023-02-11 15:03:44,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/info/e9d6ff66e2f04bd39be087bc5458e0b1, entries=12, sequenceid=21, filesize=6.3 K 2023-02-11 15:03:44,209 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/.tmp/rep_barrier/22ef55da949a4f198b6a642dd7a930c3 as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/rep_barrier/22ef55da949a4f198b6a642dd7a930c3 2023-02-11 15:03:44,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22ef55da949a4f198b6a642dd7a930c3 2023-02-11 15:03:44,213 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/rep_barrier/22ef55da949a4f198b6a642dd7a930c3, entries=1, sequenceid=21, filesize=5.1 K 2023-02-11 15:03:44,214 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/.tmp/table/bb2891c377994d1db73aaeca0e83a110 as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/table/bb2891c377994d1db73aaeca0e83a110 2023-02-11 15:03:44,217 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb2891c377994d1db73aaeca0e83a110 2023-02-11 15:03:44,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/table/bb2891c377994d1db73aaeca0e83a110, entries=4, sequenceid=21, filesize=5.1 K 2023-02-11 15:03:44,218 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:44,218 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:44,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=21, compaction requested=false 2023-02-11 15:03:44,221 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-11 15:03:44,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 15:03:44,225 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:44,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:44,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127824144Running coprocessor pre-close hooks at 1676127824144Disabling compacts and flushes for region at 1676127824144Disabling writes for close at 1676127824144Obtaining lock to block concurrent updates at 1676127824144Preparing flush snapshotting stores in 1588230740 at 1676127824144Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676127824144Flushing stores of hbase:meta,,1.1588230740 at 1676127824147 (+3 ms)Flushing 1588230740/info: creating writer at 1676127824147Flushing 1588230740/info: appending metadata at 1676127824149 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676127824149Flushing 1588230740/rep_barrier: creating writer at 1676127824174 (+25 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676127824176 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676127824176Flushing 1588230740/table: creating writer at 1676127824191 (+15 ms)Flushing 1588230740/table: appending metadata at 1676127824193 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676127824193Flushing 1588230740/info: reopening flushed file at 1676127824205 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676127824209 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676127824214 (+5 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=21, compaction requested=false at 1676127824221 (+7 ms)Writing region close event to WAL at 1676127824222 (+1 ms)Running coprocessor post-close hooks at 1676127824225 (+3 ms)Closed at 1676127824225 2023-02-11 15:03:44,226 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:44,338 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:44,338 INFO [RS:0;jenkins-hbase4:43467] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43467,1676127821206; zookeeper connection closed. 2023-02-11 15:03:44,338 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28d4f466 rejected from java.util.concurrent.ThreadPoolExecutor@29fb80be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,338 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:43467-0x10043e8c7150001, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:44,338 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@321c421e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@321c421e 2023-02-11 15:03:44,338 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a59c4a7 rejected from java.util.concurrent.ThreadPoolExecutor@29fb80be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,344 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42265,1676127821232; all regions closed. 2023-02-11 15:03:44,347 DEBUG [RS:1;jenkins-hbase4:42265] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/oldWALs 2023-02-11 15:03:44,347 INFO [RS:1;jenkins-hbase4:42265] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42265%2C1676127821232.meta:.meta(num 1676127821739) 2023-02-11 15:03:44,350 DEBUG [RS:1;jenkins-hbase4:42265] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/oldWALs 2023-02-11 15:03:44,350 INFO [RS:1;jenkins-hbase4:42265] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42265%2C1676127821232:(num 1676127822150) 2023-02-11 15:03:44,350 DEBUG [RS:1;jenkins-hbase4:42265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,350 INFO [RS:1;jenkins-hbase4:42265] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:44,351 INFO [RS:1;jenkins-hbase4:42265] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:44,351 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:44,352 INFO [RS:1;jenkins-hbase4:42265] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42265 2023-02-11 15:03:44,354 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42265,1676127821232 2023-02-11 15:03:44,354 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:44,354 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50eaba36 rejected from java.util.concurrent.ThreadPoolExecutor@54d524f3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,356 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42265,1676127821232] 2023-02-11 15:03:44,356 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42265,1676127821232; numProcessing=2 2023-02-11 15:03:44,357 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42265,1676127821232 already deleted, retry=false 2023-02-11 15:03:44,357 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42265,1676127821232 expired; onlineServers=0 2023-02-11 15:03:44,357 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37067,1676127821157' ***** 2023-02-11 15:03:44,357 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:44,358 DEBUG [M:0;jenkins-hbase4:37067] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4baa99ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:44,358 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37067,1676127821157 2023-02-11 15:03:44,358 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37067,1676127821157; all regions closed. 2023-02-11 15:03:44,358 DEBUG [M:0;jenkins-hbase4:37067] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:44,358 DEBUG [M:0;jenkins-hbase4:37067] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:44,358 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:44,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127821390] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127821390,5,FailOnTimeoutGroup] 2023-02-11 15:03:44,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127821390] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127821390,5,FailOnTimeoutGroup] 2023-02-11 15:03:44,358 DEBUG [M:0;jenkins-hbase4:37067] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:44,359 INFO [M:0;jenkins-hbase4:37067] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:44,360 INFO [M:0;jenkins-hbase4:37067] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:44,360 INFO [M:0;jenkins-hbase4:37067] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:44,360 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:44,360 DEBUG [M:0;jenkins-hbase4:37067] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:44,360 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:44,360 INFO [M:0;jenkins-hbase4:37067] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:44,360 ERROR [M:0;jenkins-hbase4:37067] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 15:03:44,360 INFO [M:0;jenkins-hbase4:37067] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:44,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:44,361 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:44,361 DEBUG [M:0;jenkins-hbase4:37067] zookeeper.ZKUtil(398): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:44,361 WARN [M:0;jenkins-hbase4:37067] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:44,361 INFO [M:0;jenkins-hbase4:37067] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:44,361 INFO [M:0;jenkins-hbase4:37067] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:44,362 DEBUG [M:0;jenkins-hbase4:37067] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:44,362 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:44,362 DEBUG [M:0;jenkins-hbase4:37067] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:44,362 DEBUG [M:0;jenkins-hbase4:37067] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:44,362 DEBUG [M:0;jenkins-hbase4:37067] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:44,362 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.68 KB heapSize=67.68 KB 2023-02-11 15:03:44,364 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:44,386 INFO [M:0;jenkins-hbase4:37067] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1506b8e61fa4493a843035b997a3e60d 2023-02-11 15:03:44,390 DEBUG [M:0;jenkins-hbase4:37067] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1506b8e61fa4493a843035b997a3e60d as hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1506b8e61fa4493a843035b997a3e60d 2023-02-11 15:03:44,394 INFO [M:0;jenkins-hbase4:37067] regionserver.HStore(1080): Added hdfs://localhost:44211/user/jenkins/test-data/66e3e0a1-8551-97a6-7c12-228e97e29e2a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1506b8e61fa4493a843035b997a3e60d, entries=17, sequenceid=132, filesize=8.7 K 2023-02-11 15:03:44,394 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegion(2947): Finished flush of dataSize ~56.68 KB/58043, heapSize ~67.66 KB/69288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=132, compaction requested=false 2023-02-11 15:03:44,395 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:44,395 DEBUG [M:0;jenkins-hbase4:37067] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127824362Disabling compacts and flushes for region at 1676127824362Disabling writes for close at 1676127824362Obtaining lock to block concurrent updates at 1676127824362Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127824362Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58043, getHeapSize=69288, getOffHeapSize=0, getCellsCount=145 at 1676127824362Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127824363 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127824363Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127824366 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127824366Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127824391 (+25 ms)Finished flush of dataSize ~56.68 KB/58043, heapSize ~67.66 KB/69288, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=132, compaction requested=false at 1676127824395 (+4 ms)Writing region close event to WAL at 1676127824395Closed at 1676127824395 2023-02-11 15:03:44,400 INFO [M:0;jenkins-hbase4:37067] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:44,400 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:44,401 INFO [M:0;jenkins-hbase4:37067] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37067 2023-02-11 15:03:44,402 DEBUG [M:0;jenkins-hbase4:37067] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37067,1676127821157 already deleted, retry=false 2023-02-11 15:03:44,742 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:44,742 INFO [M:0;jenkins-hbase4:37067] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37067,1676127821157; zookeeper connection closed. 2023-02-11 15:03:44,742 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34c2aac6 rejected from java.util.concurrent.ThreadPoolExecutor@30fd3886[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,743 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): master:37067-0x10043e8c7150000, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:44,743 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6575c757 rejected from java.util.concurrent.ThreadPoolExecutor@30fd3886[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,842 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:44,842 INFO [RS:1;jenkins-hbase4:42265] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42265,1676127821232; zookeeper connection closed. 2023-02-11 15:03:44,842 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25b2a4e3 rejected from java.util.concurrent.ThreadPoolExecutor@54d524f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,842 DEBUG [Listener at localhost/43861-EventThread] zookeeper.ZKWatcher(600): regionserver:42265-0x10043e8c7150002, quorum=127.0.0.1:53525, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:44,842 ERROR [Listener at localhost/43861-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d83cb27 rejected from java.util.concurrent.ThreadPoolExecutor@54d524f3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:44,842 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@275e9aa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@275e9aa 2023-02-11 15:03:44,843 INFO [Listener at localhost/43861] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:44,843 WARN [Listener at localhost/43861] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:44,847 INFO [Listener at localhost/43861] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:44,951 WARN [BP-190472236-172.31.14.131-1676127820352 heartbeating to localhost/127.0.0.1:44211] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:44,951 WARN [BP-190472236-172.31.14.131-1676127820352 heartbeating to localhost/127.0.0.1:44211] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-190472236-172.31.14.131-1676127820352 (Datanode Uuid 2f3a6338-587c-4b5e-8b44-321a97e9a75b) service to localhost/127.0.0.1:44211 2023-02-11 15:03:44,952 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/dfs/data/data3/current/BP-190472236-172.31.14.131-1676127820352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:44,952 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/dfs/data/data4/current/BP-190472236-172.31.14.131-1676127820352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:44,953 WARN [Listener at localhost/43861] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:44,956 INFO [Listener at localhost/43861] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:45,060 WARN [BP-190472236-172.31.14.131-1676127820352 heartbeating to localhost/127.0.0.1:44211] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:45,060 WARN [BP-190472236-172.31.14.131-1676127820352 heartbeating to localhost/127.0.0.1:44211] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-190472236-172.31.14.131-1676127820352 (Datanode Uuid f2996ad2-b3cf-470e-abc4-49d2333c2224) service to localhost/127.0.0.1:44211 2023-02-11 15:03:45,061 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/dfs/data/data1/current/BP-190472236-172.31.14.131-1676127820352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:45,061 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/cluster_dda34a4e-3ebb-7020-00e0-3215abf75b89/dfs/data/data2/current/BP-190472236-172.31.14.131-1676127820352] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:45,071 INFO [Listener at localhost/43861] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:45,184 INFO [Listener at localhost/43861] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:45,200 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:45,212 INFO [Listener at localhost/43861] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 255) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43861 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44211 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:44211 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44211 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,37067,1676127821157)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44211 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44211 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:44211 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:44211 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=568 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 271), ProcessCount=167 (was 167), AvailableMemoryMB=3767 (was 3812) 2023-02-11 15:03:45,223 INFO [Listener at localhost/43861] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=568, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=167, AvailableMemoryMB=3766 2023-02-11 15:03:45,236 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/hadoop.log.dir so I do NOT create it in target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c 2023-02-11 15:03:45,236 WARN [Listener at localhost/43861] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/hadoop.log.dir Erasing configuration value by system value. 2023-02-11 15:03:45,236 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/hadoop.tmp.dir so I do NOT create it in target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c 2023-02-11 15:03:45,236 WARN [Listener at localhost/43861] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b7bc3c54-3786-b187-df36-2c85865e359a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-11 15:03:45,236 DEBUG [Listener at localhost/43861] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c 2023-02-11 15:03:45,236 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-11 15:03:45,236 INFO [Listener at localhost/43861] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6, deleteOnExit=true 2023-02-11 15:03:45,236 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/test.cache.data in system properties and HBase conf 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/hadoop.tmp.dir in system properties and HBase conf 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/hadoop.log.dir in system properties and HBase conf 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-11 15:03:45,237 DEBUG [Listener at localhost/43861] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:45,237 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/nfs.dump.dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/java.io.tmpdir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-11 15:03:45,238 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-11 15:03:45,239 INFO [Listener at localhost/43861] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-11 15:03:45,242 WARN [Listener at localhost/43861] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:45,243 WARN [Listener at localhost/43861] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:45,283 WARN [Listener at localhost/43861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:45,284 INFO [Listener at localhost/43861] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:45,290 INFO [Listener at localhost/43861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/java.io.tmpdir/Jetty_localhost_44567_hdfs____uwv080/webapp 2023-02-11 15:03:45,382 INFO [Listener at localhost/43861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44567 2023-02-11 15:03:45,386 WARN [Listener at localhost/43861] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-11 15:03:45,387 WARN [Listener at localhost/43861] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-11 15:03:45,423 WARN [Listener at localhost/39193] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:45,438 WARN [Listener at localhost/39193] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:45,440 WARN [Listener at localhost/39193] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:45,441 INFO [Listener at localhost/39193] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:45,447 INFO [Listener at localhost/39193] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/java.io.tmpdir/Jetty_localhost_37585_datanode____.yu0p3f/webapp 2023-02-11 15:03:45,539 INFO [Listener at localhost/39193] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37585 2023-02-11 15:03:45,549 WARN [Listener at localhost/41277] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:45,566 WARN [Listener at localhost/41277] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-11 15:03:45,568 WARN [Listener at localhost/41277] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-11 15:03:45,569 INFO [Listener at localhost/41277] log.Slf4jLog(67): jetty-6.1.26 2023-02-11 15:03:45,575 INFO [Listener at localhost/41277] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/java.io.tmpdir/Jetty_localhost_37293_datanode____xrwmhb/webapp 2023-02-11 15:03:45,657 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x881432fd2834bc8c: Processing first storage report for DS-a6a59565-e08f-4234-ad58-69eb6fe6043c from datanode e180036f-c5b2-4aa3-ab8a-69470f911c4e 2023-02-11 15:03:45,657 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x881432fd2834bc8c: from storage DS-a6a59565-e08f-4234-ad58-69eb6fe6043c node DatanodeRegistration(127.0.0.1:43087, datanodeUuid=e180036f-c5b2-4aa3-ab8a-69470f911c4e, infoPort=33713, infoSecurePort=0, ipcPort=41277, storageInfo=lv=-57;cid=testClusterID;nsid=1342388902;c=1676127825245), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:45,657 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x881432fd2834bc8c: Processing first storage report for DS-5ef20962-f26e-4afa-ae29-c08ee1053305 from datanode e180036f-c5b2-4aa3-ab8a-69470f911c4e 2023-02-11 15:03:45,657 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x881432fd2834bc8c: from storage DS-5ef20962-f26e-4afa-ae29-c08ee1053305 node DatanodeRegistration(127.0.0.1:43087, datanodeUuid=e180036f-c5b2-4aa3-ab8a-69470f911c4e, infoPort=33713, infoSecurePort=0, ipcPort=41277, storageInfo=lv=-57;cid=testClusterID;nsid=1342388902;c=1676127825245), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:45,683 INFO [Listener at localhost/41277] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37293 2023-02-11 15:03:45,691 WARN [Listener at localhost/39343] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-11 15:03:45,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcc64c92046e78fec: Processing first storage report for DS-4130be48-829b-43ce-ae9d-82968dd82e5e from datanode 7851d174-d9ab-4c6c-b150-aefee74b0932 2023-02-11 15:03:45,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcc64c92046e78fec: from storage DS-4130be48-829b-43ce-ae9d-82968dd82e5e node DatanodeRegistration(127.0.0.1:40645, datanodeUuid=7851d174-d9ab-4c6c-b150-aefee74b0932, infoPort=43913, infoSecurePort=0, ipcPort=39343, storageInfo=lv=-57;cid=testClusterID;nsid=1342388902;c=1676127825245), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:45,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcc64c92046e78fec: Processing first storage report for DS-dd1db8c4-753a-4f93-ba31-ac267bbafeb4 from datanode 7851d174-d9ab-4c6c-b150-aefee74b0932 2023-02-11 15:03:45,786 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcc64c92046e78fec: from storage DS-dd1db8c4-753a-4f93-ba31-ac267bbafeb4 node DatanodeRegistration(127.0.0.1:40645, datanodeUuid=7851d174-d9ab-4c6c-b150-aefee74b0932, infoPort=43913, infoSecurePort=0, ipcPort=39343, storageInfo=lv=-57;cid=testClusterID;nsid=1342388902;c=1676127825245), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-11 15:03:45,799 DEBUG [Listener at localhost/39343] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c 2023-02-11 15:03:45,802 INFO [Listener at localhost/39343] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/zookeeper_0, clientPort=49301, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-11 15:03:45,803 INFO [Listener at localhost/39343] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49301 2023-02-11 15:03:45,803 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,804 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,819 INFO [Listener at localhost/39343] util.FSUtils(479): Created version file at hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0 with version=8 2023-02-11 15:03:45,819 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,820 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,820 INFO [Listener at localhost/39343] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/hbase-staging 2023-02-11 15:03:45,822 INFO [Listener at localhost/39343] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:45,822 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,822 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,822 INFO [Listener at localhost/39343] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:45,822 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,822 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:45,823 INFO [Listener at localhost/39343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:45,823 INFO [Listener at localhost/39343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44449 2023-02-11 15:03:45,823 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,824 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,825 INFO [Listener at localhost/39343] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44449 connecting to ZooKeeper ensemble=127.0.0.1:49301 2023-02-11 15:03:45,833 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:444490x0, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:45,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:44449-0x10043e8d94d0000 connected 2023-02-11 15:03:45,847 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:45,847 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:45,847 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:45,852 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44449 2023-02-11 15:03:45,852 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44449 2023-02-11 15:03:45,852 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44449 2023-02-11 15:03:45,853 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44449 2023-02-11 15:03:45,855 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44449 2023-02-11 15:03:45,855 INFO [Listener at localhost/39343] master.HMaster(439): hbase.rootdir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0, hbase.cluster.distributed=false 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:45,868 INFO [Listener at localhost/39343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:45,872 INFO [Listener at localhost/39343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41465 2023-02-11 15:03:45,872 INFO [Listener at localhost/39343] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:45,872 DEBUG [Listener at localhost/39343] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:45,873 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,874 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,874 INFO [Listener at localhost/39343] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41465 connecting to ZooKeeper ensemble=127.0.0.1:49301 2023-02-11 15:03:45,876 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:414650x0, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:45,877 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): regionserver:414650x0, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:45,877 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): regionserver:414650x0, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:45,878 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): regionserver:414650x0, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:45,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41465-0x10043e8d94d0001 connected 2023-02-11 15:03:45,884 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41465 2023-02-11 15:03:45,884 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41465 2023-02-11 15:03:45,884 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41465 2023-02-11 15:03:45,889 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41465 2023-02-11 15:03:45,890 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41465 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-11 15:03:45,906 INFO [Listener at localhost/39343] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-11 15:03:45,907 INFO [Listener at localhost/39343] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44225 2023-02-11 15:03:45,908 INFO [Listener at localhost/39343] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-11 15:03:45,909 DEBUG [Listener at localhost/39343] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:45,909 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,910 INFO [Listener at localhost/39343] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,912 INFO [Listener at localhost/39343] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44225 connecting to ZooKeeper ensemble=127.0.0.1:49301 2023-02-11 15:03:45,916 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:442250x0, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-11 15:03:45,917 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): regionserver:442250x0, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:45,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44225-0x10043e8d94d0002 connected 2023-02-11 15:03:45,918 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:45,918 DEBUG [Listener at localhost/39343] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-11 15:03:45,919 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44225 2023-02-11 15:03:45,919 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44225 2023-02-11 15:03:45,919 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44225 2023-02-11 15:03:45,920 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44225 2023-02-11 15:03:45,922 DEBUG [Listener at localhost/39343] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44225 2023-02-11 15:03:45,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:45,936 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:45,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:45,938 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:45,938 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:45,938 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:45,938 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:45,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:45,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44449,1676127825822 from backup master directory 2023-02-11 15:03:45,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-11 15:03:45,943 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:45,943 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:45,943 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-11 15:03:45,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:45,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/hbase.id with ID: ff3a6619-607d-4f07-aec1-1600c948cf2a 2023-02-11 15:03:45,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-11 15:03:45,964 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:45,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x015fcce1 to 127.0.0.1:49301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:45,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2993e631, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:45,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:45,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-11 15:03:45,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:45,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store-tmp 2023-02-11 15:03:45,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:45,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:45,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:45,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:45,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:45,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:45,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:45,983 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127825983Disabling compacts and flushes for region at 1676127825983Disabling writes for close at 1676127825983Writing region close event to WAL at 1676127825983Closed at 1676127825983 2023-02-11 15:03:45,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/WALs/jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:45,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44449%2C1676127825822, suffix=, logDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/WALs/jenkins-hbase4.apache.org,44449,1676127825822, archiveDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/oldWALs, maxLogs=10 2023-02-11 15:03:45,998 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK] 2023-02-11 15:03:45,998 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK] 2023-02-11 15:03:46,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/WALs/jenkins-hbase4.apache.org,44449,1676127825822/jenkins-hbase4.apache.org%2C44449%2C1676127825822.1676127825986 2023-02-11 15:03:46,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK], DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK]] 2023-02-11 15:03:46,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:46,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:46,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:46,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:46,001 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:46,002 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-11 15:03:46,002 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-11 15:03:46,003 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:46,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:46,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-11 15:03:46,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:46,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63015043, jitterRate=-0.061002686619758606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:46,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676127826000Initializing all the Stores at 1676127826001 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127826001Cleaning up temporary data from old regions at 1676127826004 (+3 ms)Cleaning up detritus from prior splits at 1676127826004Region opened successfully at 1676127826009 (+5 ms) 2023-02-11 15:03:46,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-11 15:03:46,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-11 15:03:46,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-11 15:03:46,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-11 15:03:46,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-11 15:03:46,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-11 15:03:46,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-11 15:03:46,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-11 15:03:46,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-11 15:03:46,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-11 15:03:46,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-11 15:03:46,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-11 15:03:46,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-11 15:03:46,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-11 15:03:46,030 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:46,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-11 15:03:46,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-11 15:03:46,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-11 15:03:46,033 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:46,033 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:46,033 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:46,033 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:46,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,44449,1676127825822, sessionid=0x10043e8d94d0000, setting cluster-up flag (Was=false) 2023-02-11 15:03:46,039 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:46,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-11 15:03:46,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:46,047 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:46,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-11 15:03:46,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:46,051 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.hbase-snapshot/.tmp 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:46,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676127856057 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-11 15:03:46,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-11 15:03:46,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,060 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:46,060 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-11 15:03:46,061 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:46,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-11 15:03:46,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-11 15:03:46,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-11 15:03:46,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-11 15:03:46,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-11 15:03:46,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127826066,5,FailOnTimeoutGroup] 2023-02-11 15:03:46,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127826068,5,FailOnTimeoutGroup] 2023-02-11 15:03:46,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-11 15:03:46,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,076 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:46,077 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:46,077 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0 2023-02-11 15:03:46,084 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:46,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:46,086 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/info 2023-02-11 15:03:46,086 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:46,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:46,088 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:46,088 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:46,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:46,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/table 2023-02-11 15:03:46,089 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:46,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,090 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740 2023-02-11 15:03:46,090 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740 2023-02-11 15:03:46,092 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:46,092 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:46,094 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:46,094 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60985040, jitterRate=-0.09125208854675293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:46,094 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676127826084Initializing all the Stores at 1676127826085 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127826085Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127826085Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127826085Cleaning up temporary data from old regions at 1676127826091 (+6 ms)Cleaning up detritus from prior splits at 1676127826091Region opened successfully at 1676127826094 (+3 ms) 2023-02-11 15:03:46,094 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:46,094 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:46,094 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:46,094 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:46,094 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:46,095 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:46,095 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127826094Disabling compacts and flushes for region at 1676127826094Disabling writes for close at 1676127826094Writing region close event to WAL at 1676127826095 (+1 ms)Closed at 1676127826095 2023-02-11 15:03:46,095 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-11 15:03:46,095 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-11 15:03:46,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-11 15:03:46,096 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-11 15:03:46,098 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-11 15:03:46,125 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(952): ClusterId : ff3a6619-607d-4f07-aec1-1600c948cf2a 2023-02-11 15:03:46,125 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(952): ClusterId : ff3a6619-607d-4f07-aec1-1600c948cf2a 2023-02-11 15:03:46,125 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:46,125 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-11 15:03:46,129 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:46,129 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:46,129 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-11 15:03:46,129 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-11 15:03:46,131 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:46,132 DEBUG [RS:1;jenkins-hbase4:44225] zookeeper.ReadOnlyZKClient(139): Connect 0x58098678 to 127.0.0.1:49301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:46,132 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-11 15:03:46,133 DEBUG [RS:0;jenkins-hbase4:41465] zookeeper.ReadOnlyZKClient(139): Connect 0x010804d3 to 127.0.0.1:49301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:46,137 DEBUG [RS:1;jenkins-hbase4:44225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56ce6309, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:46,137 DEBUG [RS:1;jenkins-hbase4:44225] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52f1ed08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:46,137 DEBUG [RS:0;jenkins-hbase4:41465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fcfea82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:46,137 DEBUG [RS:0;jenkins-hbase4:41465] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bf06fa3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:46,146 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44225 2023-02-11 15:03:46,146 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41465 2023-02-11 15:03:46,146 INFO [RS:1;jenkins-hbase4:44225] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:46,146 INFO [RS:0;jenkins-hbase4:41465] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-11 15:03:46,146 INFO [RS:0;jenkins-hbase4:41465] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:46,146 INFO [RS:1;jenkins-hbase4:44225] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-11 15:03:46,146 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:46,146 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1023): About to register with Master. 2023-02-11 15:03:46,147 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44449,1676127825822 with isa=jenkins-hbase4.apache.org/172.31.14.131:41465, startcode=1676127825867 2023-02-11 15:03:46,147 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,44449,1676127825822 with isa=jenkins-hbase4.apache.org/172.31.14.131:44225, startcode=1676127825905 2023-02-11 15:03:46,147 DEBUG [RS:0;jenkins-hbase4:41465] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:46,147 DEBUG [RS:1;jenkins-hbase4:44225] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-11 15:03:46,148 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46525, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:46,148 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42295, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-11 15:03:46,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44449] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,150 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,151 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0 2023-02-11 15:03:46,151 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0 2023-02-11 15:03:46,151 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39193 2023-02-11 15:03:46,151 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39193 2023-02-11 15:03:46,151 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:46,151 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-11 15:03:46,166 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:46,167 DEBUG [RS:0;jenkins-hbase4:41465] zookeeper.ZKUtil(162): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,167 DEBUG [RS:1;jenkins-hbase4:44225] zookeeper.ZKUtil(162): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,167 WARN [RS:0;jenkins-hbase4:41465] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:46,167 WARN [RS:1;jenkins-hbase4:44225] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-11 15:03:46,167 INFO [RS:0;jenkins-hbase4:41465] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:46,167 INFO [RS:1;jenkins-hbase4:44225] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:46,167 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,167 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41465,1676127825867] 2023-02-11 15:03:46,168 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44225,1676127825905] 2023-02-11 15:03:46,167 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,177 DEBUG [RS:1;jenkins-hbase4:44225] zookeeper.ZKUtil(162): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,177 DEBUG [RS:0;jenkins-hbase4:41465] zookeeper.ZKUtil(162): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,177 DEBUG [RS:1;jenkins-hbase4:44225] zookeeper.ZKUtil(162): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,177 DEBUG [RS:0;jenkins-hbase4:41465] zookeeper.ZKUtil(162): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,178 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:46,178 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-11 15:03:46,178 INFO [RS:1;jenkins-hbase4:44225] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:46,178 INFO [RS:0;jenkins-hbase4:41465] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-11 15:03:46,179 INFO [RS:1;jenkins-hbase4:44225] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:46,179 INFO [RS:1;jenkins-hbase4:44225] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:46,179 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,180 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:46,186 INFO [RS:0;jenkins-hbase4:41465] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-11 15:03:46,186 INFO [RS:0;jenkins-hbase4:41465] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-11 15:03:46,186 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,187 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-11 15:03:46,187 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,189 DEBUG [RS:1;jenkins-hbase4:44225] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,190 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,190 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,190 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,190 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,190 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,191 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,191 DEBUG [RS:0;jenkins-hbase4:41465] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-11 15:03:46,192 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,193 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,193 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,202 INFO [RS:1;jenkins-hbase4:44225] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:46,202 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44225,1676127825905-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,203 INFO [RS:0;jenkins-hbase4:41465] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-11 15:03:46,203 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41465,1676127825867-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,213 INFO [RS:1;jenkins-hbase4:44225] regionserver.Replication(203): jenkins-hbase4.apache.org,44225,1676127825905 started 2023-02-11 15:03:46,213 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44225,1676127825905, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44225, sessionid=0x10043e8d94d0002 2023-02-11 15:03:46,215 INFO [RS:0;jenkins-hbase4:41465] regionserver.Replication(203): jenkins-hbase4.apache.org,41465,1676127825867 started 2023-02-11 15:03:46,215 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:46,215 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41465,1676127825867, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41465, sessionid=0x10043e8d94d0001 2023-02-11 15:03:46,215 DEBUG [RS:1;jenkins-hbase4:44225] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,215 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-11 15:03:46,215 DEBUG [RS:0;jenkins-hbase4:41465] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,215 DEBUG [RS:0;jenkins-hbase4:41465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41465,1676127825867' 2023-02-11 15:03:46,215 DEBUG [RS:0;jenkins-hbase4:41465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:46,215 DEBUG [RS:1;jenkins-hbase4:44225] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44225,1676127825905' 2023-02-11 15:03:46,215 DEBUG [RS:1;jenkins-hbase4:44225] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:46,215 DEBUG [RS:0;jenkins-hbase4:41465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:46,215 DEBUG [RS:1;jenkins-hbase4:44225] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:46,216 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:46,216 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:46,216 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-11 15:03:46,216 DEBUG [RS:0;jenkins-hbase4:41465] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,216 DEBUG [RS:0;jenkins-hbase4:41465] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41465,1676127825867' 2023-02-11 15:03:46,216 DEBUG [RS:0;jenkins-hbase4:41465] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:46,216 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-11 15:03:46,216 DEBUG [RS:1;jenkins-hbase4:44225] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,216 DEBUG [RS:1;jenkins-hbase4:44225] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44225,1676127825905' 2023-02-11 15:03:46,216 DEBUG [RS:1;jenkins-hbase4:44225] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:46,216 DEBUG [RS:0;jenkins-hbase4:41465] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:46,216 DEBUG [RS:1;jenkins-hbase4:44225] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:46,217 DEBUG [RS:0;jenkins-hbase4:41465] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:46,217 DEBUG [RS:1;jenkins-hbase4:44225] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-11 15:03:46,217 INFO [RS:0;jenkins-hbase4:41465] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:46,217 INFO [RS:0;jenkins-hbase4:41465] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:46,217 INFO [RS:1;jenkins-hbase4:44225] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-11 15:03:46,217 INFO [RS:1;jenkins-hbase4:44225] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-11 15:03:46,248 DEBUG [jenkins-hbase4:44449] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-11 15:03:46,248 DEBUG [jenkins-hbase4:44449] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:46,250 DEBUG [jenkins-hbase4:44449] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:46,250 DEBUG [jenkins-hbase4:44449] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:46,250 DEBUG [jenkins-hbase4:44449] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:46,250 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41465,1676127825867, state=OPENING 2023-02-11 15:03:46,251 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-11 15:03:46,252 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:46,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41465,1676127825867}] 2023-02-11 15:03:46,253 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:46,407 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:46,408 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:46,411 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:46,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-11 15:03:46,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-11 15:03:46,419 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41465%2C1676127825867.meta, suffix=.meta, logDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,41465,1676127825867, archiveDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/oldWALs, maxLogs=32 2023-02-11 15:03:46,435 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK] 2023-02-11 15:03:46,435 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK] 2023-02-11 15:03:46,437 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,41465,1676127825867/jenkins-hbase4.apache.org%2C41465%2C1676127825867.meta.1676127826419.meta 2023-02-11 15:03:46,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK], DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK]] 2023-02-11 15:03:46,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:46,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-11 15:03:46,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-11 15:03:46,438 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-11 15:03:46,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-11 15:03:46,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:46,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-11 15:03:46,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-11 15:03:46,439 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-11 15:03:46,440 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/info 2023-02-11 15:03:46,440 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/info 2023-02-11 15:03:46,440 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-11 15:03:46,440 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-11 15:03:46,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:46,441 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/rep_barrier 2023-02-11 15:03:46,442 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-11 15:03:46,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-11 15:03:46,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/table 2023-02-11 15:03:46,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/table 2023-02-11 15:03:46,443 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-11 15:03:46,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740 2023-02-11 15:03:46,445 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740 2023-02-11 15:03:46,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-11 15:03:46,448 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-11 15:03:46,449 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69026920, jitterRate=0.02858126163482666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-11 15:03:46,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676127826438Writing region info on filesystem at 1676127826438Initializing all the Stores at 1676127826439 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127826439Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127826439Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127826439Cleaning up temporary data from old regions at 1676127826446 (+7 ms)Cleaning up detritus from prior splits at 1676127826446Running coprocessor post-open hooks at 1676127826449 (+3 ms)Region opened successfully at 1676127826449 2023-02-11 15:03:46,450 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676127826407 2023-02-11 15:03:46,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-11 15:03:46,454 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-11 15:03:46,454 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41465,1676127825867, state=OPEN 2023-02-11 15:03:46,455 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-11 15:03:46,455 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-11 15:03:46,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-11 15:03:46,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41465,1676127825867 in 202 msec 2023-02-11 15:03:46,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-11 15:03:46,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-11 15:03:46,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 407 msec 2023-02-11 15:03:46,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676127825936, completionTime=-1 2023-02-11 15:03:46,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-11 15:03:46,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-11 15:03:46,464 DEBUG [hconnection-0x41052023-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:46,468 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41322, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:46,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-11 15:03:46,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676127886469 2023-02-11 15:03:46,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676127946469 2023-02-11 15:03:46,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44449,1676127825822-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44449,1676127825822-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44449,1676127825822-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44449, period=300000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-11 15:03:46,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:46,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-11 15:03:46,481 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-11 15:03:46,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:46,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:46,483 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,484 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08 empty. 2023-02-11 15:03:46,484 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,484 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-11 15:03:46,494 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:46,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fd414a0ef2ce740442dbec4a04beb08, NAME => 'hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp 2023-02-11 15:03:46,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:46,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4fd414a0ef2ce740442dbec4a04beb08, disabling compactions & flushes 2023-02-11 15:03:46,505 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. after waiting 0 ms 2023-02-11 15:03:46,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,505 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4fd414a0ef2ce740442dbec4a04beb08: Waiting for close lock at 1676127826505Disabling compacts and flushes for region at 1676127826505Disabling writes for close at 1676127826505Writing region close event to WAL at 1676127826505Closed at 1676127826505 2023-02-11 15:03:46,508 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:46,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127826508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127826508"}]},"ts":"1676127826508"} 2023-02-11 15:03:46,510 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:46,511 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:46,511 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127826511"}]},"ts":"1676127826511"} 2023-02-11 15:03:46,512 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-11 15:03:46,515 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:46,516 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:46,516 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:46,516 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:46,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4fd414a0ef2ce740442dbec4a04beb08, ASSIGN}] 2023-02-11 15:03:46,519 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4fd414a0ef2ce740442dbec4a04beb08, ASSIGN 2023-02-11 15:03:46,520 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4fd414a0ef2ce740442dbec4a04beb08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44225,1676127825905; forceNewPlan=false, retain=false 2023-02-11 15:03:46,670 INFO [jenkins-hbase4:44449] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:46,670 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4fd414a0ef2ce740442dbec4a04beb08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127826670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127826670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127826670"}]},"ts":"1676127826670"} 2023-02-11 15:03:46,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4fd414a0ef2ce740442dbec4a04beb08, server=jenkins-hbase4.apache.org,44225,1676127825905}] 2023-02-11 15:03:46,825 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,826 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-11 15:03:46,827 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38630, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-11 15:03:46,831 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,832 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44225%2C1676127825905, suffix=, logDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,44225,1676127825905, archiveDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/oldWALs, maxLogs=32 2023-02-11 15:03:46,872 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK] 2023-02-11 15:03:46,873 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK] 2023-02-11 15:03:46,883 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,44225,1676127825905/jenkins-hbase4.apache.org%2C44225%2C1676127825905.1676127826833 2023-02-11 15:03:46,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK], DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK]] 2023-02-11 15:03:46,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fd414a0ef2ce740442dbec4a04beb08, NAME => 'hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:46,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:46,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,885 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,888 INFO [StoreOpener-4fd414a0ef2ce740442dbec4a04beb08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,889 DEBUG [StoreOpener-4fd414a0ef2ce740442dbec4a04beb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/info 2023-02-11 15:03:46,890 DEBUG [StoreOpener-4fd414a0ef2ce740442dbec4a04beb08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/info 2023-02-11 15:03:46,890 INFO [StoreOpener-4fd414a0ef2ce740442dbec4a04beb08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fd414a0ef2ce740442dbec4a04beb08 columnFamilyName info 2023-02-11 15:03:46,891 INFO [StoreOpener-4fd414a0ef2ce740442dbec4a04beb08-1] regionserver.HStore(310): Store=4fd414a0ef2ce740442dbec4a04beb08/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:46,891 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,892 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,896 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:46,920 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:46,921 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fd414a0ef2ce740442dbec4a04beb08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65208317, jitterRate=-0.02832035720348358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-11 15:03:46,921 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fd414a0ef2ce740442dbec4a04beb08: Running coprocessor pre-open hook at 1676127826885Writing region info on filesystem at 1676127826885Initializing all the Stores at 1676127826886 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676127826886Cleaning up temporary data from old regions at 1676127826892 (+6 ms)Cleaning up detritus from prior splits at 1676127826893 (+1 ms)Running coprocessor post-open hooks at 1676127826921 (+28 ms)Region opened successfully at 1676127826921 2023-02-11 15:03:46,922 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08., pid=6, masterSystemTime=1676127826825 2023-02-11 15:03:46,926 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,928 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:46,928 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4fd414a0ef2ce740442dbec4a04beb08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:46,929 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676127826928"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127826928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127826928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127826928"}]},"ts":"1676127826928"} 2023-02-11 15:03:46,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-11 15:03:46,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4fd414a0ef2ce740442dbec4a04beb08, server=jenkins-hbase4.apache.org,44225,1676127825905 in 258 msec 2023-02-11 15:03:46,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-11 15:03:46,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4fd414a0ef2ce740442dbec4a04beb08, ASSIGN in 416 msec 2023-02-11 15:03:46,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:46,934 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127826934"}]},"ts":"1676127826934"} 2023-02-11 15:03:46,936 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-11 15:03:46,942 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:46,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 462 msec 2023-02-11 15:03:46,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-11 15:03:46,983 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:46,983 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:46,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:46,986 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:46,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-11 15:03:46,994 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:46,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-11 15:03:46,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-11 15:03:47,007 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-11 15:03:47,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-11 15:03:47,031 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-11 15:03:47,034 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-11 15:03:47,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.091sec 2023-02-11 15:03:47,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-11 15:03:47,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-11 15:03:47,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-11 15:03:47,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44449,1676127825822-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-11 15:03:47,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44449,1676127825822-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-11 15:03:47,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-11 15:03:47,126 DEBUG [Listener at localhost/39343] zookeeper.ReadOnlyZKClient(139): Connect 0x1783c817 to 127.0.0.1:49301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:47,129 DEBUG [Listener at localhost/39343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73912b69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:47,131 DEBUG [hconnection-0x10d64612-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:47,132 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41338, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:47,134 INFO [Listener at localhost/39343] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:47,134 DEBUG [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-11 15:03:47,138 DEBUG [Listener at localhost/39343] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-11 15:03:47,140 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52670, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-11 15:03:47,140 INFO [Listener at localhost/39343] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 15:03:47,141 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 15:03:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-11 15:03:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:52670 deadline: 1676127887141, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-11 15:03:47,142 INFO [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-11 15:03:47,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-11 15:03:47,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-11 15:03:47,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-11 15:03:47,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-11 15:03:47,148 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-11 15:03:47,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:47,150 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,150 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb empty. 2023-02-11 15:03:47,151 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,151 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 15:03:47,168 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-11 15:03:47,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b987bc40678208823dd34d852f3c78fb, NAME => 'testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp 2023-02-11 15:03:47,219 INFO [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41465%2C1676127825867, suffix=, logDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,41465,1676127825867, archiveDir=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/oldWALs, maxLogs=32 2023-02-11 15:03:47,240 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK] 2023-02-11 15:03:47,240 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK] 2023-02-11 15:03:47,246 INFO [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,41465,1676127825867/jenkins-hbase4.apache.org%2C41465%2C1676127825867.1676127827220 2023-02-11 15:03:47,246 DEBUG [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40645,DS-4130be48-829b-43ce-ae9d-82968dd82e5e,DISK], DatanodeInfoWithStorage[127.0.0.1:43087,DS-a6a59565-e08f-4234-ad58-69eb6fe6043c,DISK]] 2023-02-11 15:03:47,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:47,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:47,605 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:47,606 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b987bc40678208823dd34d852f3c78fb, disabling compactions & flushes 2023-02-11 15:03:47,606 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,606 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,606 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. after waiting 0 ms 2023-02-11 15:03:47,606 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,606 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,606 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b987bc40678208823dd34d852f3c78fb: Waiting for close lock at 1676127827606Disabling compacts and flushes for region at 1676127827606Disabling writes for close at 1676127827606Writing region close event to WAL at 1676127827606Closed at 1676127827606 2023-02-11 15:03:47,608 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-11 15:03:47,609 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676127827609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127827609"}]},"ts":"1676127827609"} 2023-02-11 15:03:47,611 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-11 15:03:47,611 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-11 15:03:47,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127827611"}]},"ts":"1676127827611"} 2023-02-11 15:03:47,612 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-11 15:03:47,616 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-11 15:03:47,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-11 15:03:47,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-11 15:03:47,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-11 15:03:47,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, ASSIGN}] 2023-02-11 15:03:47,618 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, ASSIGN 2023-02-11 15:03:47,619 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41465,1676127825867; forceNewPlan=false, retain=false 2023-02-11 15:03:47,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:47,769 INFO [jenkins-hbase4:44449] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-11 15:03:47,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b987bc40678208823dd34d852f3c78fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:47,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676127827769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127827769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127827769"}]},"ts":"1676127827769"} 2023-02-11 15:03:47,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b987bc40678208823dd34d852f3c78fb, server=jenkins-hbase4.apache.org,41465,1676127825867}] 2023-02-11 15:03:47,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b987bc40678208823dd34d852f3c78fb, NAME => 'testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.', STARTKEY => '', ENDKEY => ''} 2023-02-11 15:03:47,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:47,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,929 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,930 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1 2023-02-11 15:03:47,930 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1 2023-02-11 15:03:47,931 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b987bc40678208823dd34d852f3c78fb columnFamilyName f1 2023-02-11 15:03:47,931 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(310): Store=b987bc40678208823dd34d852f3c78fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:47,931 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,933 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2 2023-02-11 15:03:47,933 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2 2023-02-11 15:03:47,933 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b987bc40678208823dd34d852f3c78fb columnFamilyName f2 2023-02-11 15:03:47,934 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(310): Store=b987bc40678208823dd34d852f3c78fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:47,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:47,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:47,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-11 15:03:47,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b987bc40678208823dd34d852f3c78fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60054283, jitterRate=-0.10512144863605499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:47,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b987bc40678208823dd34d852f3c78fb: Running coprocessor pre-open hook at 1676127827928Writing region info on filesystem at 1676127827928Initializing all the Stores at 1676127827929 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127827929Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127827929Cleaning up temporary data from old regions at 1676127827936 (+7 ms)Cleaning up detritus from prior splits at 1676127827936Running coprocessor post-open hooks at 1676127827941 (+5 ms)Region opened successfully at 1676127827941 2023-02-11 15:03:47,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb., pid=12, masterSystemTime=1676127827923 2023-02-11 15:03:47,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:47,944 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b987bc40678208823dd34d852f3c78fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:47,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676127827944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676127827944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676127827944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676127827944"}]},"ts":"1676127827944"} 2023-02-11 15:03:47,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-11 15:03:47,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b987bc40678208823dd34d852f3c78fb, server=jenkins-hbase4.apache.org,41465,1676127825867 in 174 msec 2023-02-11 15:03:47,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-11 15:03:47,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, ASSIGN in 330 msec 2023-02-11 15:03:47,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-11 15:03:47,952 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127827951"}]},"ts":"1676127827951"} 2023-02-11 15:03:47,953 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-11 15:03:47,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-11 15:03:47,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 811 msec 2023-02-11 15:03:48,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-11 15:03:48,255 INFO [Listener at localhost/39343] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-11 15:03:48,256 DEBUG [Listener at localhost/39343] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-11 15:03:48,256 INFO [Listener at localhost/39343] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:48,263 INFO [Listener at localhost/39343] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-11 15:03:48,263 INFO [Listener at localhost/39343] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-11 15:03:48,263 INFO [Listener at localhost/39343] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-11 15:03:48,263 INFO [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-11 15:03:48,376 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41465] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:48,461 INFO [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-11 15:03:48,462 INFO [Listener at localhost/39343] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-11 15:03:48,463 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:48,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676127828463 (current time:1676127828463). 2023-02-11 15:03:48,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-11 15:03:48,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] zookeeper.ReadOnlyZKClient(139): Connect 0x64903078 to 127.0.0.1:49301 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-11 15:03:48,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c2dc0c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-11 15:03:48,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-11 15:03:48,470 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41340, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-11 15:03:48,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64903078 to 127.0.0.1:49301 2023-02-11 15:03:48,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:48,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-11 15:03:48,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:48,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:48,475 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:48,476 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676128428476 2023-02-11 15:03:48,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-11 15:03:48,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-11 15:03:48,477 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-11 15:03:48,477 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:48,477 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-11 15:03:48,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:48,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-11 15:03:48,479 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:48,479 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676128428479 2023-02-11 15:03:48,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-11 15:03:48,487 INFO [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-11 15:03:48,487 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:48,488 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-11 15:03:48,488 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-11 15:03:48,488 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,488 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,491 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:48,491 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:48,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:48,491 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:48,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:48,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:48,491 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,491 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:48,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-11 15:03:48,492 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-11 15:03:48,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-11 15:03:48,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-11 15:03:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-11 15:03:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-11 15:03:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:48,493 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-11 15:03:48,494 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 15:03:48,494 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-11 15:03:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-11 15:03:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44225,1676127825905' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-11 15:03:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-11 15:03:48,496 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41465,1676127825867' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-11 15:03:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,498 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:48,498 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 15:03:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:48,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41465,1676127825867' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-11 15:03:48,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@320f2134[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:48,500 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-11 15:03:48,500 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,501 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,501 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 15:03:48,502 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,502 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-11 15:03:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-11 15:03:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44225,1676127825905' in zk 2023-02-11 15:03:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-11 15:03:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-11 15:03:48,502 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:48,502 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. started... 2023-02-11 15:03:48,502 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b987bc40678208823dd34d852f3c78fb 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-11 15:03:48,504 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-11 15:03:48,504 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:48,504 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-11 15:03:48,531 WARN [DataStreamer for file /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f1/042adb46709b4986a497883cc360d8ec] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-11 15:03:48,532 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f1/042adb46709b4986a497883cc360d8ec 2023-02-11 15:03:48,558 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f2/538e100046da49d7a258c1ddd4c0b751 2023-02-11 15:03:48,562 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f1/042adb46709b4986a497883cc360d8ec as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/042adb46709b4986a497883cc360d8ec 2023-02-11 15:03:48,566 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/042adb46709b4986a497883cc360d8ec, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:48,567 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f2/538e100046da49d7a258c1ddd4c0b751 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/538e100046da49d7a258c1ddd4c0b751 2023-02-11 15:03:48,572 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/538e100046da49d7a258c1ddd4c0b751, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-11 15:03:48,573 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b987bc40678208823dd34d852f3c78fb in 71ms, sequenceid=5, compaction requested=false 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b987bc40678208823dd34d852f3c78fb: 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/042adb46709b4986a497883cc360d8ec] hfiles 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/042adb46709b4986a497883cc360d8ec for snapshot=testWithMapReduceSingleRegion 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/538e100046da49d7a258c1ddd4c0b751] hfiles 2023-02-11 15:03:48,573 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/538e100046da49d7a258c1ddd4c0b751 for snapshot=testWithMapReduceSingleRegion 2023-02-11 15:03:48,577 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:48,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:48,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:48,579 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-11 15:03:48,584 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. completed. 2023-02-11 15:03:48,584 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-11 15:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-11 15:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-11 15:03:48,584 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41465,1676127825867' in zk 2023-02-11 15:03:48,587 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-11 15:03:48,587 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,587 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:48,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:48,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:48,587 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-11 15:03:48,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 15:03:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 15:03:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,41465,1676127825867': 2023-02-11 15:03:48,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41465,1676127825867' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-11 15:03:48,590 INFO [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-11 15:03:48,590 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:48,590 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:48,590 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-11 15:03:48,590 INFO [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-11 15:03:48,592 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:48,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-11 15:03:48,592 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:48,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,593 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:48,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:48,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:48,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:48,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:48,593 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 15:03:48,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:48,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 15:03:48,595 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,595 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-11 15:03:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:48,601 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:48,602 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:48,602 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:48,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,601 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-11 15:03:48,602 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:48,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-11 15:03:48,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:48,602 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-11 15:03:48,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-11 15:03:48,602 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-11 15:03:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:48,602 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-11 15:03:48,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-11 15:03:48,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 15:03:48,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:48,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-11 15:03:48,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-11 15:03:48,779 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:48,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:48,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-11 15:03:48,781 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-11 15:03:49,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-11 15:03:49,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-11 15:03:49,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 15:03:49,073 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-11 15:03:49,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676127828476Consolidate snapshot: testWithMapReduceSingleRegion at 1676127828602 (+126 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676127828602Writing data manifest for testWithMapReduceSingleRegion at 1676127828612 (+10 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676127829027 (+415 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676127829072 (+45 ms) 2023-02-11 15:03:49,074 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-11 15:03:49,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 598 msec 2023-02-11 15:03:49,081 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-11 15:03:49,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-11 15:03:49,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-11 15:03:49,082 INFO [Listener at localhost/39343] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-11 15:03:49,088 INFO [Listener at localhost/39343] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-11 15:03:49,110 INFO [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-11 15:03:49,146 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41465] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,263 INFO [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-11 15:03:49,268 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-11 15:03:49,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-11 15:03:49,271 INFO [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-11 15:03:49,271 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:49,271 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-11 15:03:49,271 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-11 15:03:49,272 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,272 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,273 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:49,273 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:49,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:49,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:49,273 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,274 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,274 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-11 15:03:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-11 15:03:49,275 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 15:03:49,275 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:49,275 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 15:03:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-11 15:03:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-11 15:03:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-11 15:03:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 15:03:49,279 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44225,1676127825905' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 15:03:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-11 15:03:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-11 15:03:49,280 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,280 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. started... 2023-02-11 15:03:49,280 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b987bc40678208823dd34d852f3c78fb 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-11 15:03:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,284 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:49,305 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f1/b1ec1d027c984977ab4d89d3d48a4f06 2023-02-11 15:03:49,357 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f2/68b9731656384fdd9e61dc3dea7355fc 2023-02-11 15:03:49,362 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f1/b1ec1d027c984977ab4d89d3d48a4f06 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/b1ec1d027c984977ab4d89d3d48a4f06 2023-02-11 15:03:49,367 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/b1ec1d027c984977ab4d89d3d48a4f06, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:49,368 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/.tmp/f2/68b9731656384fdd9e61dc3dea7355fc as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/68b9731656384fdd9e61dc3dea7355fc 2023-02-11 15:03:49,373 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/68b9731656384fdd9e61dc3dea7355fc, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-11 15:03:49,374 INFO [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b987bc40678208823dd34d852f3c78fb in 93ms, sequenceid=9, compaction requested=false 2023-02-11 15:03:49,374 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b987bc40678208823dd34d852f3c78fb: 2023-02-11 15:03:49,374 DEBUG [rs(jenkins-hbase4.apache.org,41465,1676127825867)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,374 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-11 15:03:49,374 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-11 15:03:49,374 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,374 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-11 15:03:49,374 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41465,1676127825867' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-11 15:03:49,376 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,376 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:49,376 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,376 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-11 15:03:49,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:49,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41465,1676127825867' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-11 15:03:49,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3630b3ad[Count = 0] remaining members to acquire global barrier 2023-02-11 15:03:49,378 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-11 15:03:49,378 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,380 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 15:03:49,380 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-11 15:03:49,380 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 15:03:49,380 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44225,1676127825905' in zk 2023-02-11 15:03:49,380 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-11 15:03:49,380 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41465,1676127825867' in zk 2023-02-11 15:03:49,380 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,380 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-11 15:03:49,382 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 15:03:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:49,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-11 15:03:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,41465,1676127825867' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 15:03:49,382 DEBUG [member: 'jenkins-hbase4.apache.org,44225,1676127825905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-11 15:03:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:49,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:49,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:49,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41465,1676127825867': 2023-02-11 15:03:49,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41465,1676127825867' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-11 15:03:49,385 INFO [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-11 15:03:49,386 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-11 15:03:49,386 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-11 15:03:49,386 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-11 15:03:49,386 INFO [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-11 15:03:49,388 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-11 15:03:49,388 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:49,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,388 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:49,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-11 15:03:49,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,389 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:49,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,390 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-11 15:03:49,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:49,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,391 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-11 15:03:49,392 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-11 15:03:49,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,393 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-11 15:03:49,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,396 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,396 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,396 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:49,396 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-11 15:03:49,396 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:49,396 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:49,406 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-11 15:03:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:49,405 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-11 15:03:49,406 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:49,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:49,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-11 15:03:49,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-11 15:03:49,406 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,407 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:49,407 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-11 15:03:49,407 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-11 15:03:49,407 DEBUG [(jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-11 15:03:49,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-11 15:03:49,407 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-11 15:03:49,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-11 15:03:49,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-11 15:03:49,407 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-11 15:03:49,407 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-11 15:03:49,507 DEBUG [Listener at localhost/39343] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-11 15:03:49,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-11 15:03:49,624 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/hadoop-3151784218088149514.jar 2023-02-11 15:03:49,636 INFO [Listener at localhost/39343] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676127828463 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:49,636 DEBUG [Listener at localhost/39343] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6/data/default/testWithMapReduce 2023-02-11 15:03:49,636 INFO [Listener at localhost/39343] snapshot.RestoreSnapshotHelper(239): region to add: b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:49,637 INFO [Listener at localhost/39343] snapshot.RestoreSnapshotHelper(585): clone region=b987bc40678208823dd34d852f3c78fb as b987bc40678208823dd34d852f3c78fb in snapshot testWithMapReduceSingleRegion 2023-02-11 15:03:49,640 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b987bc40678208823dd34d852f3c78fb, NAME => 'testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6 2023-02-11 15:03:49,658 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:49,658 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 042adb46709b4986a497883cc360d8ec from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-11 15:03:49,664 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 538e100046da49d7a258c1ddd4c0b751 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-11 15:03:49,672 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b987bc40678208823dd34d852f3c78fb, disabling compactions & flushes 2023-02-11 15:03:49,672 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,672 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. after waiting 0 ms 2023-02-11 15:03:49,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,673 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:49,673 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b987bc40678208823dd34d852f3c78fb: Waiting for close lock at 1676127829672Disabling compacts and flushes for region at 1676127829672Disabling writes for close at 1676127829673 (+1 ms)Writing region close event to WAL at 1676127829673Closed at 1676127829673 2023-02-11 15:03:49,673 INFO [Listener at localhost/39343] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676127828463 type: FLUSH version: 2 ttl: 0 2023-02-11 15:03:49,673 DEBUG [Listener at localhost/39343] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6 2023-02-11 15:03:49,673 DEBUG [Listener at localhost/39343] util.CommonFSUtils(682): File system contents for path hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6 2023-02-11 15:03:49,674 DEBUG [Listener at localhost/39343] util.CommonFSUtils(699): |-data/ 2023-02-11 15:03:49,675 DEBUG [Listener at localhost/39343] util.CommonFSUtils(699): |----default/ 2023-02-11 15:03:49,676 DEBUG [Listener at localhost/39343] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-11 15:03:49,676 DEBUG [Listener at localhost/39343] util.CommonFSUtils(699): |----------b987bc40678208823dd34d852f3c78fb/ 2023-02-11 15:03:49,677 DEBUG [Listener at localhost/39343] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-11 15:03:49,677 DEBUG [Listener at localhost/39343] util.CommonFSUtils(699): |-------------f1/ 2023-02-11 15:03:49,677 DEBUG [Listener at localhost/39343] util.CommonFSUtils(702): |----------------testWithMapReduce=b987bc40678208823dd34d852f3c78fb-042adb46709b4986a497883cc360d8ec 2023-02-11 15:03:49,677 DEBUG [Listener at localhost/39343] util.CommonFSUtils(699): |-------------f2/ 2023-02-11 15:03:49,678 DEBUG [Listener at localhost/39343] util.CommonFSUtils(702): |----------------testWithMapReduce=b987bc40678208823dd34d852f3c78fb-538e100046da49d7a258c1ddd4c0b751 2023-02-11 15:03:49,678 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:49,679 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:49,680 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:49,680 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,798 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/hadoop-925664539388107983.jar 2023-02-11 15:03:50,799 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,799 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,867 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/hadoop-1379437840949507321.jar 2023-02-11 15:03:50,867 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,868 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,868 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,869 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,869 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,869 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,869 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-11 15:03:50,870 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-11 15:03:50,870 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-11 15:03:50,871 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-11 15:03:50,871 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-11 15:03:50,871 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-11 15:03:50,872 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-11 15:03:50,872 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-11 15:03:50,872 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-11 15:03:50,873 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-11 15:03:50,873 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-11 15:03:50,874 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:50,874 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:50,875 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-11 15:03:50,875 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 15:03:50,953 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/hadoop-788515149196577697.jar 2023-02-11 15:03:50,954 DEBUG [Listener at localhost/39343] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-11 15:03:50,963 WARN [Listener at localhost/39343] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-11 15:03:50,973 WARN [Listener at localhost/39343] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-11 15:03:50,982 INFO [Listener at localhost/39343] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-11 15:03:51,095 WARN [Listener at localhost/39343] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/mapreduce.cluster.local.dir/1676127831054/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-11 15:03:51,095 WARN [Listener at localhost/39343] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/mapreduce.cluster.local.dir/1676127831054/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-11 15:03:51,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-11 15:03:51,134 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-11 15:03:51,134 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-11 15:03:51,137 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:51,138 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1 2023-02-11 15:03:51,138 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b987bc40678208823dd34d852f3c78fb columnFamilyName f1 2023-02-11 15:03:51,144 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(539): loaded hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/testWithMapReduce=b987bc40678208823dd34d852f3c78fb-042adb46709b4986a497883cc360d8ec 2023-02-11 15:03:51,144 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(310): Store=b987bc40678208823dd34d852f3c78fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:51,144 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:51,145 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2 2023-02-11 15:03:51,146 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b987bc40678208823dd34d852f3c78fb columnFamilyName f2 2023-02-11 15:03:51,150 DEBUG [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(539): loaded hdfs://localhost:39193/user/jenkins/test-data/d4425ffc-12fa-e333-3103-b1c487ded29e/testWithMapReduceSingleRegion/7ee0a606-1a68-4548-9467-b5127e30e7f6/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/testWithMapReduce=b987bc40678208823dd34d852f3c78fb-538e100046da49d7a258c1ddd4c0b751 2023-02-11 15:03:51,150 INFO [StoreOpener-b987bc40678208823dd34d852f3c78fb-1] regionserver.HStore(310): Store=b987bc40678208823dd34d852f3c78fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-11 15:03:51,150 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-11 15:03:51,151 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b987bc40678208823dd34d852f3c78fb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62464622, jitterRate=-0.06920459866523743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-11 15:03:51,151 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b987bc40678208823dd34d852f3c78fb: Writing region info on filesystem at 1676127831134Initializing all the Stores at 1676127831136 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127831136Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676127831136Region opened successfully at 1676127831151 (+15 ms) 2023-02-11 15:03:51,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b987bc40678208823dd34d852f3c78fb, disabling compactions & flushes 2023-02-11 15:03:51,303 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:51,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:51,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. after waiting 0 ms 2023-02-11 15:03:51,303 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:51,304 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:51,304 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b987bc40678208823dd34d852f3c78fb: Waiting for close lock at 1676127831303Disabling compacts and flushes for region at 1676127831303Disabling writes for close at 1676127831303Writing region close event to WAL at 1676127831304 (+1 ms)Closed at 1676127831304 2023-02-11 15:03:52,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-11 15:03:52,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-11 15:03:52,140 INFO [Listener at localhost/39343] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-11 15:03:52,141 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-11 15:03:52,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:52,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127832144"}]},"ts":"1676127832144"} 2023-02-11 15:03:52,145 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-11 15:03:52,147 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-11 15:03:52,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, UNASSIGN}] 2023-02-11 15:03:52,148 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, UNASSIGN 2023-02-11 15:03:52,148 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b987bc40678208823dd34d852f3c78fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:52,148 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676127832148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676127832148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676127832148"}]},"ts":"1676127832148"} 2023-02-11 15:03:52,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b987bc40678208823dd34d852f3c78fb, server=jenkins-hbase4.apache.org,41465,1676127825867}] 2023-02-11 15:03:52,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:52,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:52,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b987bc40678208823dd34d852f3c78fb, disabling compactions & flushes 2023-02-11 15:03:52,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:52,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:52,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. after waiting 0 ms 2023-02-11 15:03:52,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:52,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-11 15:03:52,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb. 2023-02-11 15:03:52,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b987bc40678208823dd34d852f3c78fb: Waiting for close lock at 1676127832301Running coprocessor pre-close hooks at 1676127832301Disabling compacts and flushes for region at 1676127832301Disabling writes for close at 1676127832301Writing region close event to WAL at 1676127832302 (+1 ms)Running coprocessor post-close hooks at 1676127832305 (+3 ms)Closed at 1676127832306 (+1 ms) 2023-02-11 15:03:52,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:52,308 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b987bc40678208823dd34d852f3c78fb, regionState=CLOSED 2023-02-11 15:03:52,308 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676127832308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676127832308"}]},"ts":"1676127832308"} 2023-02-11 15:03:52,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-11 15:03:52,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b987bc40678208823dd34d852f3c78fb, server=jenkins-hbase4.apache.org,41465,1676127825867 in 160 msec 2023-02-11 15:03:52,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-11 15:03:52,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b987bc40678208823dd34d852f3c78fb, UNASSIGN in 163 msec 2023-02-11 15:03:52,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676127832312"}]},"ts":"1676127832312"} 2023-02-11 15:03:52,313 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-11 15:03:52,316 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-11 15:03:52,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 175 msec 2023-02-11 15:03:52,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-11 15:03:52,446 INFO [Listener at localhost/39343] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-11 15:03:52,447 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-11 15:03:52,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,450 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,451 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:52,454 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:52,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1, FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2, FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/recovered.edits] 2023-02-11 15:03:52,459 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/042adb46709b4986a497883cc360d8ec to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/archive/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/042adb46709b4986a497883cc360d8ec 2023-02-11 15:03:52,460 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/b1ec1d027c984977ab4d89d3d48a4f06 to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/archive/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f1/b1ec1d027c984977ab4d89d3d48a4f06 2023-02-11 15:03:52,462 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/538e100046da49d7a258c1ddd4c0b751 to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/archive/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/538e100046da49d7a258c1ddd4c0b751 2023-02-11 15:03:52,463 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/68b9731656384fdd9e61dc3dea7355fc to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/archive/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/f2/68b9731656384fdd9e61dc3dea7355fc 2023-02-11 15:03:52,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/recovered.edits/12.seqid to hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/archive/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb/recovered.edits/12.seqid 2023-02-11 15:03:52,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/.tmp/data/default/testWithMapReduce/b987bc40678208823dd34d852f3c78fb 2023-02-11 15:03:52,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-11 15:03:52,467 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,469 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-11 15:03:52,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-11 15:03:52,472 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,472 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-11 15:03:52,472 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676127832472"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:52,473 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-11 15:03:52,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b987bc40678208823dd34d852f3c78fb, NAME => 'testWithMapReduce,,1676127827144.b987bc40678208823dd34d852f3c78fb.', STARTKEY => '', ENDKEY => ''}] 2023-02-11 15:03:52,473 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-11 15:03:52,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676127832473"}]},"ts":"9223372036854775807"} 2023-02-11 15:03:52,479 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-11 15:03:52,480 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-11 15:03:52,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 33 msec 2023-02-11 15:03:52,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44449] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-11 15:03:52,553 INFO [Listener at localhost/39343] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-11 15:03:52,553 INFO [Listener at localhost/39343] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-11 15:03:52,553 INFO [Listener at localhost/39343] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-11 15:03:52,553 DEBUG [Listener at localhost/39343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1783c817 to 127.0.0.1:49301 2023-02-11 15:03:52,553 DEBUG [Listener at localhost/39343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:52,553 DEBUG [Listener at localhost/39343] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-11 15:03:52,553 DEBUG [Listener at localhost/39343] util.JVMClusterUtil(257): Found active master hash=630750332, stopped=false 2023-02-11 15:03:52,553 INFO [Listener at localhost/39343] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:52,555 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:52,555 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:52,555 INFO [Listener at localhost/39343] procedure2.ProcedureExecutor(629): Stopping 2023-02-11 15:03:52,555 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-11 15:03:52,555 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:52,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:52,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:52,558 DEBUG [Listener at localhost/39343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x015fcce1 to 127.0.0.1:49301 2023-02-11 15:03:52,558 DEBUG [Listener at localhost/39343] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:52,558 INFO [Listener at localhost/39343] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41465,1676127825867' ***** 2023-02-11 15:03:52,559 INFO [Listener at localhost/39343] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:52,559 INFO [Listener at localhost/39343] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44225,1676127825905' ***** 2023-02-11 15:03:52,559 INFO [RS:0;jenkins-hbase4:41465] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:52,559 INFO [RS:0;jenkins-hbase4:41465] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:52,558 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-11 15:03:52,559 INFO [RS:0;jenkins-hbase4:41465] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:52,559 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:52,559 INFO [Listener at localhost/39343] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-11 15:03:52,559 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:52,560 DEBUG [RS:0;jenkins-hbase4:41465] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x010804d3 to 127.0.0.1:49301 2023-02-11 15:03:52,560 INFO [RS:1;jenkins-hbase4:44225] regionserver.HeapMemoryManager(220): Stopping 2023-02-11 15:03:52,560 DEBUG [RS:0;jenkins-hbase4:41465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:52,560 INFO [RS:1;jenkins-hbase4:44225] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-11 15:03:52,560 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-11 15:03:52,560 INFO [RS:1;jenkins-hbase4:44225] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-11 15:03:52,560 INFO [RS:0;jenkins-hbase4:41465] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:52,561 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(3304): Received CLOSE for 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:52,561 INFO [RS:0;jenkins-hbase4:41465] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:52,561 INFO [RS:0;jenkins-hbase4:41465] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:52,562 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-11 15:03:52,562 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:52,562 DEBUG [RS:1;jenkins-hbase4:44225] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58098678 to 127.0.0.1:49301 2023-02-11 15:03:52,562 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fd414a0ef2ce740442dbec4a04beb08, disabling compactions & flushes 2023-02-11 15:03:52,562 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-11 15:03:52,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:52,562 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:52,562 DEBUG [RS:1;jenkins-hbase4:44225] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:52,562 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-11 15:03:52,562 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1479): Online Regions={4fd414a0ef2ce740442dbec4a04beb08=hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08.} 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. after waiting 0 ms 2023-02-11 15:03:52,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-11 15:03:52,562 DEBUG [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1505): Waiting on 4fd414a0ef2ce740442dbec4a04beb08 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-11 15:03:52,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:52,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4fd414a0ef2ce740442dbec4a04beb08 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-11 15:03:52,562 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-11 15:03:52,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/.tmp/info/c41b7f6ddec5470d99270363b8a8f5c3 2023-02-11 15:03:52,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/.tmp/info/c41b7f6ddec5470d99270363b8a8f5c3 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/info/c41b7f6ddec5470d99270363b8a8f5c3 2023-02-11 15:03:52,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/info/c41b7f6ddec5470d99270363b8a8f5c3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-11 15:03:52,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4fd414a0ef2ce740442dbec4a04beb08 in 26ms, sequenceid=6, compaction requested=false 2023-02-11 15:03:52,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/namespace/4fd414a0ef2ce740442dbec4a04beb08/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-11 15:03:52,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:52,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fd414a0ef2ce740442dbec4a04beb08: Waiting for close lock at 1676127832562Running coprocessor pre-close hooks at 1676127832562Disabling compacts and flushes for region at 1676127832562Disabling writes for close at 1676127832562Obtaining lock to block concurrent updates at 1676127832562Preparing flush snapshotting stores in 4fd414a0ef2ce740442dbec4a04beb08 at 1676127832562Finished memstore snapshotting hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676127832563 (+1 ms)Flushing stores of hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. at 1676127832563Flushing 4fd414a0ef2ce740442dbec4a04beb08/info: creating writer at 1676127832563Flushing 4fd414a0ef2ce740442dbec4a04beb08/info: appending metadata at 1676127832566 (+3 ms)Flushing 4fd414a0ef2ce740442dbec4a04beb08/info: closing flushed file at 1676127832566Flushing 4fd414a0ef2ce740442dbec4a04beb08/info: reopening flushed file at 1676127832584 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4fd414a0ef2ce740442dbec4a04beb08 in 26ms, sequenceid=6, compaction requested=false at 1676127832588 (+4 ms)Writing region close event to WAL at 1676127832589 (+1 ms)Running coprocessor post-close hooks at 1676127832592 (+3 ms)Closed at 1676127832593 (+1 ms) 2023-02-11 15:03:52,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676127826480.4fd414a0ef2ce740442dbec4a04beb08. 2023-02-11 15:03:52,613 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:52,615 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:52,762 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:52,762 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44225,1676127825905; all regions closed. 2023-02-11 15:03:52,766 DEBUG [RS:1;jenkins-hbase4:44225] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/oldWALs 2023-02-11 15:03:52,766 INFO [RS:1;jenkins-hbase4:44225] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44225%2C1676127825905:(num 1676127826833) 2023-02-11 15:03:52,766 DEBUG [RS:1;jenkins-hbase4:44225] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:52,767 INFO [RS:1;jenkins-hbase4:44225] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:52,767 INFO [RS:1;jenkins-hbase4:44225] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:52,767 INFO [RS:1;jenkins-hbase4:44225] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-11 15:03:52,767 INFO [RS:1;jenkins-hbase4:44225] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-11 15:03:52,767 INFO [RS:1;jenkins-hbase4:44225] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-11 15:03:52,768 INFO [RS:1;jenkins-hbase4:44225] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44225 2023-02-11 15:03:52,768 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:52,770 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:52,770 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44225,1676127825905 2023-02-11 15:03:52,770 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@665ca5d6 rejected from java.util.concurrent.ThreadPoolExecutor@62633dc5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:52,770 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:52,770 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:52,770 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:52,770 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@15fd6b4a rejected from java.util.concurrent.ThreadPoolExecutor@62633dc5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:52,771 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44225,1676127825905] 2023-02-11 15:03:52,771 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44225,1676127825905; numProcessing=1 2023-02-11 15:03:52,773 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44225,1676127825905 already deleted, retry=false 2023-02-11 15:03:52,773 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44225,1676127825905 expired; onlineServers=1 2023-02-11 15:03:52,957 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:52,957 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6dfa9437 rejected from java.util.concurrent.ThreadPoolExecutor@62633dc5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:52,957 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:44225-0x10043e8d94d0002, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:52,958 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3917c43a rejected from java.util.concurrent.ThreadPoolExecutor@62633dc5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:52,958 INFO [RS:1;jenkins-hbase4:44225] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44225,1676127825905; zookeeper connection closed. 2023-02-11 15:03:52,962 DEBUG [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-11 15:03:52,965 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f1e4634] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f1e4634 2023-02-11 15:03:52,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/.tmp/info/1a9e5250117a49a38125e16d9f1ecb69 2023-02-11 15:03:52,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a9e5250117a49a38125e16d9f1ecb69 2023-02-11 15:03:53,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/.tmp/rep_barrier/17b4aec7690d41b593ffe4bd37a5be11 2023-02-11 15:03:53,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17b4aec7690d41b593ffe4bd37a5be11 2023-02-11 15:03:53,017 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/.tmp/table/684120e913a345e9bf6ab35b7126f1e9 2023-02-11 15:03:53,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 684120e913a345e9bf6ab35b7126f1e9 2023-02-11 15:03:53,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/.tmp/info/1a9e5250117a49a38125e16d9f1ecb69 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/info/1a9e5250117a49a38125e16d9f1ecb69 2023-02-11 15:03:53,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a9e5250117a49a38125e16d9f1ecb69 2023-02-11 15:03:53,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/info/1a9e5250117a49a38125e16d9f1ecb69, entries=12, sequenceid=21, filesize=6.2 K 2023-02-11 15:03:53,025 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/.tmp/rep_barrier/17b4aec7690d41b593ffe4bd37a5be11 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/rep_barrier/17b4aec7690d41b593ffe4bd37a5be11 2023-02-11 15:03:53,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17b4aec7690d41b593ffe4bd37a5be11 2023-02-11 15:03:53,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/rep_barrier/17b4aec7690d41b593ffe4bd37a5be11, entries=1, sequenceid=21, filesize=5.0 K 2023-02-11 15:03:53,029 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/.tmp/table/684120e913a345e9bf6ab35b7126f1e9 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/table/684120e913a345e9bf6ab35b7126f1e9 2023-02-11 15:03:53,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 684120e913a345e9bf6ab35b7126f1e9 2023-02-11 15:03:53,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/table/684120e913a345e9bf6ab35b7126f1e9, entries=4, sequenceid=21, filesize=5.0 K 2023-02-11 15:03:53,033 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 471ms, sequenceid=21, compaction requested=false 2023-02-11 15:03:53,040 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-11 15:03:53,041 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-11 15:03:53,042 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:53,042 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676127832562Running coprocessor pre-close hooks at 1676127832562Disabling compacts and flushes for region at 1676127832562Disabling writes for close at 1676127832562Obtaining lock to block concurrent updates at 1676127832563 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676127832563Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676127832563Flushing stores of hbase:meta,,1.1588230740 at 1676127832564 (+1 ms)Flushing 1588230740/info: creating writer at 1676127832564Flushing 1588230740/info: appending metadata at 1676127832566 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676127832566Flushing 1588230740/rep_barrier: creating writer at 1676127832984 (+418 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676127832986 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676127832986Flushing 1588230740/table: creating writer at 1676127833005 (+19 ms)Flushing 1588230740/table: appending metadata at 1676127833007 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676127833007Flushing 1588230740/info: reopening flushed file at 1676127833021 (+14 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676127833025 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676127833029 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 471ms, sequenceid=21, compaction requested=false at 1676127833033 (+4 ms)Writing region close event to WAL at 1676127833034 (+1 ms)Running coprocessor post-close hooks at 1676127833041 (+7 ms)Closed at 1676127833042 (+1 ms) 2023-02-11 15:03:53,043 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-11 15:03:53,163 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41465,1676127825867; all regions closed. 2023-02-11 15:03:53,166 DEBUG [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/oldWALs 2023-02-11 15:03:53,167 INFO [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41465%2C1676127825867.meta:.meta(num 1676127826419) 2023-02-11 15:03:53,170 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/WALs/jenkins-hbase4.apache.org,41465,1676127825867/jenkins-hbase4.apache.org%2C41465%2C1676127825867.1676127827220 not finished, retry = 0 2023-02-11 15:03:53,209 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-11 15:03:53,209 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-11 15:03:53,272 DEBUG [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/oldWALs 2023-02-11 15:03:53,272 INFO [RS:0;jenkins-hbase4:41465] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41465%2C1676127825867:(num 1676127827220) 2023-02-11 15:03:53,272 DEBUG [RS:0;jenkins-hbase4:41465] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:53,272 INFO [RS:0;jenkins-hbase4:41465] regionserver.LeaseManager(133): Closed leases 2023-02-11 15:03:53,273 INFO [RS:0;jenkins-hbase4:41465] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-11 15:03:53,273 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:53,278 INFO [RS:0;jenkins-hbase4:41465] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41465 2023-02-11 15:03:53,280 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41465,1676127825867 2023-02-11 15:03:53,280 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-11 15:03:53,281 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41465,1676127825867] 2023-02-11 15:03:53,281 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41465,1676127825867; numProcessing=2 2023-02-11 15:03:53,282 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41465,1676127825867 already deleted, retry=false 2023-02-11 15:03:53,282 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41465,1676127825867 expired; onlineServers=0 2023-02-11 15:03:53,282 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44449,1676127825822' ***** 2023-02-11 15:03:53,282 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-11 15:03:53,283 DEBUG [M:0;jenkins-hbase4:44449] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21a7fc17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-11 15:03:53,283 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44449,1676127825822 2023-02-11 15:03:53,283 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44449,1676127825822; all regions closed. 2023-02-11 15:03:53,283 DEBUG [M:0;jenkins-hbase4:44449] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-11 15:03:53,283 DEBUG [M:0;jenkins-hbase4:44449] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-11 15:03:53,283 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-11 15:03:53,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127826066] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676127826066,5,FailOnTimeoutGroup] 2023-02-11 15:03:53,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127826068] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676127826068,5,FailOnTimeoutGroup] 2023-02-11 15:03:53,283 DEBUG [M:0;jenkins-hbase4:44449] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-11 15:03:53,285 INFO [M:0;jenkins-hbase4:44449] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-11 15:03:53,285 INFO [M:0;jenkins-hbase4:44449] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-11 15:03:53,285 INFO [M:0;jenkins-hbase4:44449] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-11 15:03:53,285 DEBUG [M:0;jenkins-hbase4:44449] master.HMaster(1502): Stopping service threads 2023-02-11 15:03:53,285 INFO [M:0;jenkins-hbase4:44449] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-11 15:03:53,286 ERROR [M:0;jenkins-hbase4:44449] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-11 15:03:53,286 INFO [M:0;jenkins-hbase4:44449] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-11 15:03:53,286 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-11 15:03:53,290 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-11 15:03:53,290 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-11 15:03:53,290 DEBUG [M:0;jenkins-hbase4:44449] zookeeper.ZKUtil(398): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-11 15:03:53,290 WARN [M:0;jenkins-hbase4:44449] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-11 15:03:53,290 INFO [M:0;jenkins-hbase4:44449] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-11 15:03:53,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-11 15:03:53,291 INFO [M:0;jenkins-hbase4:44449] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-11 15:03:53,291 DEBUG [M:0;jenkins-hbase4:44449] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-11 15:03:53,291 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:53,291 DEBUG [M:0;jenkins-hbase4:44449] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:53,291 DEBUG [M:0;jenkins-hbase4:44449] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-11 15:03:53,291 DEBUG [M:0;jenkins-hbase4:44449] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:53,291 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-11 15:03:53,300 INFO [M:0;jenkins-hbase4:44449] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ed68eb80b4b64a5aaff213b1ccca3de2 2023-02-11 15:03:53,304 DEBUG [M:0;jenkins-hbase4:44449] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ed68eb80b4b64a5aaff213b1ccca3de2 as hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ed68eb80b4b64a5aaff213b1ccca3de2 2023-02-11 15:03:53,308 INFO [M:0;jenkins-hbase4:44449] regionserver.HStore(1080): Added hdfs://localhost:39193/user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ed68eb80b4b64a5aaff213b1ccca3de2, entries=17, sequenceid=132, filesize=8.6 K 2023-02-11 15:03:53,309 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-11 15:03:53,310 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-11 15:03:53,310 DEBUG [M:0;jenkins-hbase4:44449] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676127833291Disabling compacts and flushes for region at 1676127833291Disabling writes for close at 1676127833291Obtaining lock to block concurrent updates at 1676127833291Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676127833291Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56025, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1676127833292 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676127833293 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676127833293Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676127833295 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676127833295Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676127833305 (+10 ms)Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676127833309 (+4 ms)Writing region close event to WAL at 1676127833310 (+1 ms)Closed at 1676127833310 2023-02-11 15:03:53,312 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e694e1c8-d9f8-9799-a583-61eb89b396c0/MasterData/WALs/jenkins-hbase4.apache.org,44449,1676127825822/jenkins-hbase4.apache.org%2C44449%2C1676127825822.1676127825986 not finished, retry = 0 2023-02-11 15:03:53,382 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:53,382 INFO [RS:0;jenkins-hbase4:41465] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41465,1676127825867; zookeeper connection closed. 2023-02-11 15:03:53,382 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6386bd9f rejected from java.util.concurrent.ThreadPoolExecutor@67b92537[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:53,382 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): regionserver:41465-0x10043e8d94d0001, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:53,382 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@63733e2d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@63733e2d 2023-02-11 15:03:53,382 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45efe6c2 rejected from java.util.concurrent.ThreadPoolExecutor@67b92537[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:53,382 INFO [Listener at localhost/39343] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-11 15:03:53,413 INFO [M:0;jenkins-hbase4:44449] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-11 15:03:53,413 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-11 15:03:53,413 INFO [M:0;jenkins-hbase4:44449] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44449 2023-02-11 15:03:53,415 DEBUG [M:0;jenkins-hbase4:44449] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44449,1676127825822 already deleted, retry=false 2023-02-11 15:03:53,516 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:53,516 INFO [M:0;jenkins-hbase4:44449] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44449,1676127825822; zookeeper connection closed. 2023-02-11 15:03:53,517 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f860c3c rejected from java.util.concurrent.ThreadPoolExecutor@4bb99114[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:53,518 DEBUG [Listener at localhost/39343-EventThread] zookeeper.ZKWatcher(600): master:44449-0x10043e8d94d0000, quorum=127.0.0.1:49301, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-11 15:03:53,518 ERROR [Listener at localhost/39343-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40675f6e rejected from java.util.concurrent.ThreadPoolExecutor@4bb99114[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-11 15:03:53,518 WARN [Listener at localhost/39343] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:53,525 INFO [Listener at localhost/39343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:53,529 WARN [BP-1398234233-172.31.14.131-1676127825245 heartbeating to localhost/127.0.0.1:39193] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:53,529 WARN [BP-1398234233-172.31.14.131-1676127825245 heartbeating to localhost/127.0.0.1:39193] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1398234233-172.31.14.131-1676127825245 (Datanode Uuid 7851d174-d9ab-4c6c-b150-aefee74b0932) service to localhost/127.0.0.1:39193 2023-02-11 15:03:53,529 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/dfs/data/data3/current/BP-1398234233-172.31.14.131-1676127825245] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:53,530 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/dfs/data/data4/current/BP-1398234233-172.31.14.131-1676127825245] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:53,531 WARN [Listener at localhost/39343] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-11 15:03:53,537 INFO [Listener at localhost/39343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:53,644 WARN [BP-1398234233-172.31.14.131-1676127825245 heartbeating to localhost/127.0.0.1:39193] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-11 15:03:53,644 WARN [BP-1398234233-172.31.14.131-1676127825245 heartbeating to localhost/127.0.0.1:39193] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1398234233-172.31.14.131-1676127825245 (Datanode Uuid e180036f-c5b2-4aa3-ab8a-69470f911c4e) service to localhost/127.0.0.1:39193 2023-02-11 15:03:53,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/dfs/data/data1/current/BP-1398234233-172.31.14.131-1676127825245] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:53,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f2b6f7c2-82d5-5b77-eba4-b048f213db8c/cluster_713ffacc-439e-7164-0ed8-d4f98ef4eaf6/dfs/data/data2/current/BP-1398234233-172.31.14.131-1676127825245] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-11 15:03:53,658 INFO [Listener at localhost/39343] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-11 15:03:53,771 INFO [Listener at localhost/39343] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-11 15:03:53,799 INFO [Listener at localhost/39343] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-11 15:03:53,813 INFO [Listener at localhost/39343] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 273) Potentially hanging thread: Listener at localhost/39343 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:39193 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:39193 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:39193 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44449,1676127825822)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39193 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39193 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39193 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (351514638) connection to localhost/127.0.0.1:39193 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=597 (was 568) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 257) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2603 (was 3766)